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PREFACE 



The Center for Occupational Education offered the North Carolina 
State Board of Education its resources to help initiate a planning, 
programming, and budgeting system in the state agencies responsible for 
administering occupational education. A Center staff member was 
assigned to develop a plan of initiation activities and to work with 
agency personnel in making changes necessary in the existing system. 
This conference was proposed as one method for disseminating the results 
of this effort to state-level occupational educators from other states. 
The 35 participants represented 16 states and the S, Office of Edu- 
cation . 

A combination of formal presentations, large and small group 
discussions, handout materials, and short, informal presentations 
resulted in the participants* finding out not only about the Center's 
North Carolina project but also about similar efforts mounted by the var 
ious state departments represented . Two presentations by consultants 
enabled the participants to compare PPB efforts in the states against a 
conceptual framework for undergoing such activities, giving them ideas 
for improvement. 

The Center wishes to thank Dr. Williams for serving as director 
of this conference and the consultants and participants who helped to 
make the conference possible. Thanks are also due Dr«, Joseph R. Clary, 
Executive Director of the North Carolina Advisory Council on Vocational 
Education, for his pre-publication review of the manuscripts Appreci- 
ation is expressed to Mrs. Sue King for editing the oral presentations 
into written form, to Mrs. Olive Maynard for typing the manuscript, and 
to the entire Center clerical and technical staff for their efforts 
toward the production of this report • 



John Kc Coster 
Director 
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INTRODUCTION 



The purpose of this conference was to di ssemiaate. to occupational 
education planners the Center *s experiences in working with one state to 
a>:sist it in initiating a PPB systema \The objectives of the conference 
were: 

1. to allow participants to inspect hov7 one state, initiated PPB 
concepts into its system of occupational education; 

2. to give participants opportunities to apply planning concepts 
to their home situation, through work sessions; and 

3. to give participants the opportunity to compare the planning 
effort in their state with that being done in other states 
represented at the conference. 

The presentations were designed to provide a mix between the 
principles of planning and management and the practical problems which 
agency personnel encounter when trying to implement those principles. 
Work sessions were scheduled to give participants time to relate infor- 
mation from the presentations to their plans for bringing change to their 
own agencies. It was believed that this could be done effectively away 
from the usual office routine, with assistance from the conference con- 
sultants. The work sessions did not materialize as scheduled for several 
reasons: (1) the presentations and discussions they stimulated overran 
their allotted time; (2) the participants indicated a preference for 
continuing the large group discussion; (3) many of the participants were 
not the only persons responsible for planning PPB implementation in 
their home state; and (4) the conference director decided that these 
factors should dictate a modification of the agenda* 

The main portion of this conference report consists of the full 
text of the presentations made by six of the speakers and an outline of 
remarks made by one other » Appendix B contains material to supplement 
the presentation of Mr* Goodman. 

Participants were also offered copies of four other documents 
which were related to the planning effort in North Carolina but which 
were not discussed in detail at the conference* Thestr. documents were: 

1. k position paper written by the conference director on "A New 
Role for the Division of Occupational Education." This paper was 
written in August, 1969, when the proposed reorganization of the Divi- 
sion was under discussion. Its main theses are that local educational 
agencies must be delegated responsibility ^nd resources for program plan- 
ning and process evaluation, and that the reorganization of the Division 
could be accomplished effectively through the structuring of a PPB. 
system. 



1. A new "Annual Local Plan for Occupational Education (Public 
Secondary Schools)/* published in February, 1970- The conference direc- 
tor assisted state staff in designing and revising this piano IL is a 
major revision of the previous format in that it us-ts Office of Educa- 
tion program codes, calls for program offerings to be based on pupil 
aspirations and manpower needs, and attempts to match proposed expendi- 
tures with programs. Copies are available from A. BulLaxd, Educa- 
tion Building, Raleigh, North Carolina 27603 • 

3 • Handbook for Use in Planning Occupational Education Programs 
published in February, 1970, to accompany the revised plan. This was 
the first such handbook published in North Carolina. It contains an 
orientation to the planning requirements of the 1968 Vocational Amend- 
ments, instructions for completing each section of the new plan, and 
tables of state and local employment statistics by occupations ( for 
1960) and by 19 occupational groupings (for 1970 and 1980)* 

4 . Planning for the North Carolina Community College System , 
Volume I; Summary and Recommendations . This document i s discussed in 
Harvey Fischer's presentation. It became available the week before the 
conference convened. The full report is available from the Department 
of Community Colleges, Education Building, Raleigh, North Carolina 
27603* This plan developed training needs based on employment projec- 
tions and educational achievement levels. It recommends enrollments 
and costs for the 1970' s. 

No record was kept of discussion comments or group meetings, but 
several of the participants who distributed materials being used in 
their home states made extended remarks, including : 

1. Philip Bailey, who discussed the development and content of 
Michigan's new manual for local administrators and that 
state's resource allocation formula; 

2, Charles Hopkins, who discussed the development and use of 
Oklahoma's revised local plan and his PPB responsibilities; 

3o Robert Seckendorf, who discussed the format of the New York 
State Plan for Vocational Education that now includes priori- 
ties and performance level indicators and New York's resource 
allocation formula ; 

4. Walter Ulrich, who discussed Utah's one-page local applica- 
tion; and 

5. Roy Ustby^ who discussed the development of Wisconsin's man- 
agement information system. 

After the. conference, an evaluation questionnaire was sent to each 
participant to determine the general attitude toward the objectives and 
procedures of the conference. That questionnaire and a brief summary of 
the findings are included as Appendix C. 
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PRESENTATIONS 



ERIC 



THE CENTER'S PLANNING, PROGRAMMING, 
AND BUDGETING PROJECT 



Robert T, Williams 

Center for Occupational Education 
North Carolina State University 



First, I wish to thank Dr. Coster publicly for including the 
work "initiation" in the title of my project « Some o£ you know me well 
enough to know of my naivete and idealism. Two years ago I was pre- 
dicting — but not too loudly--that by now North Carolina would be well 
along the road to full implementation of PPB in occupational education. 
For the past month, I've been asking myself if we've really done enough 
to justify this conference. Dr. Coster and I have been disappointed 
that more has not been accomplished. It is easy to sit in my office at 
the Center, rtad books and articles about PPB, and draw up an implemen- 
tation schedule; but I forget that I am only one of many inputs to the 
agencies. The agency people tell us they are pleased with what has 
been accomplished — that without help from the Center they would not 
have gotten so far. You will have to look behind all the paper we have 
produced to see changes in attitudes and understandings which will facil 
itate the further implementation of PPB. I'll let each of you decide 
the extent of our effectiveness for yourself^ 

I hope that in this morning session we can establish the kind of 
rapport which will allow us to be open with er.ch other. Every state 
has problems in occupational education* Each of us knows that we are 
not serving all those who could benefit from occupational education. 
Few of us can be satisfied with our completion rates., our follov7-up 
studies, our cost/effectiveness record, and our federal-state-local rela 
tions. We face political, economic, sociological, attltudinal, and 
pedagogical problems. I would hope that in deciding to spend three 
days here you said to yourself, "Perhaps we have solved some problems 
others are facing now," as well as "Perhaps someone there will have a 
solution to this problem I have now." Please don't leave North Carolina 
outo We need help, too. 

I wish to spend a few minutes sketching the historical background 
of this project. The 1957 North Carolina General Assembly appropriated 
money for the state's first industrial education center* The impetus 
came not from educators, but from industrialists. A non-educator was 
appointed state T 6c I supervisor and given authority to build a system 
of area vocational schools, serving both secondary and postsecondary stu 
dents. By the summer of 1963, the system had grown to 20 institutions. 
The 1963 General Assembly created the Department of Community Colleges 
and pulled the industrial education centers out of secondary vocational 
education. The organization chart which is in your package of materials 
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shows that the Director of the Department of Communirv 0)^eg^es reports 
directly to the State Board of Education. This arrange,ir>vit has pre- 
vailed since 1963. Secondary students who had enrol mi th«.^ industrial 
education centers were allowed to continue until graduati^'n, but iho 
centers have since evolved into postsecondary and adult, technical insti- 
tutes and community colleges. In the areas of curricuJura arci cu J at ion, 
allocation of resources to local units, student reporting, le.acht-r train- 
ing, and planning, the two agencies and their prograins ha-^*? o\»orat.ed 
largely independent of each other. 

In June of 1967, Dr. Coster attended the first t:'F>spoi'.sorrjd PPB 
conference at the University of Maryland. In Sept.eniber of that year he 
added to the Center staff a man with seven years oi esperience m teach- 
ing and administering occupational education in Nortl'j Carol iriao This man 
was concerned with the rapid expansion of the community coliei^'' syst -in 
and the possibility of developing a resource aJJocation formula by which 
the state agency could coordinate an orderly growth of the system u'lth a 
proper mix and distribution of curricula. Dr. Coster* :^ awareness of the 
potential which PPB offers to the management of occupational education 
led to my investigation of this project in the spring of 1968, and its 
establishment that August. In conducting the project we have tried to 
follow these five principles: 

1. to use vocabulary consistent with federal reporting require- 
ments and national PPB usage; 

2. to be consistent with PPB plans under development in the state 
budget office; 

3. to lead and teach agency personnel rather than to hand them a 
completed package to which they did not contribute; 

4. to keep most project activities at the operations Level rather 
than at the theory and model-making level, and 

5. to avoid repeating studies done by other state agencies (e.g«, 
population projections, occupational demand studies, etc.). 

Dr . Coster has categorized this project as developmental , rather 
than one pursuing basic research. By this we mean tht: Cenr.e.r's responsi- 
bility is to assist one or more agencies in incorporating an already 
existing body of knowledge into its activities. More specifically I re- 
viewed the literature on PPB, selected material which seemed most useful 
and applicable, and tried to introduce it into the operations of the Divi- 
sion of Occupational Education in the Department of Public Instruct ion « 
It didn't work this way with the Department of Community Colleges because 
of their contract with the Research Triangle Institute « 

North Carolina was selected as the pilot state because it vras con- 
venient, because I was familiar with its program and people, and because 
both agency directors and the State Board of Education were vrilling to 
participate. 
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One assumption I made in the fall of 1968 pro/r^d fals.^. [ assumed 
that as part of the commitment to this project, each of the agancie.^ 
would designate one of its staff members as a fun-rime PPB n;an . Thi.- 
did not happen e Project liaison was a collateral duty for the two sta 
members designated to work with me. When I realised this I had to back 
up and regroup- This also meant that their regular dutios usually took 
precedence over my inputs « One of the most valuable, things \ have 
Jearned--and it just solidified this past month-^is that I cannot sche d- 
ule change o 1 must be patient. 

1 call your attention to the package of materials you picked up 
last night, specifically the "Calendar of Significant Proj--ct Events." 
The calendar may not indicate to you that the pa.'^t year has been a par- 
ticularly rough one for the Division of Occupaticnal Education- They 
experienced a new allocation formula, a new method of granting allot- 
ments, a new administration in general education in the state department, 
a new state director, a cessation of many of their traditional functions 
and relationships, and a major interna] reorganization. One staff mem- 
ber said, "The apple basket was turned upside down." More accurately, 
he might have said, "The apple basket was turned upside down, the apples 
were skinned, they were smashed, and then they were tcld to make like an 
orange." This situation may well be the reason why more implementation 
of PPB could not be accomplished during this particular year. 

The calendar also indicates that in February we produced a hand- 
book for annual planning by LEA's and associated forms. Many of you 
have a copy. In February it seemed almost perfect; now we know it 
leaves much to be desired. When Leon Minear was here in April , he said, 
"Bob, if your handbook can get the local people to see their responsibility 
to make programs responsive to student aspirations and manpower needs the 
first year, you've done a good job." That is about all it accomplished- 
We are disappointed in many of the plans which were submitter. Columns 
were not added accurately, cross-checks were not used, instructions were 
not followed. It is now obvious that most of the LEA's did not have the 
time, resources, or experience to complete this first plan satisf actori ly • 
The first local long-range plans will be submitted this fall, with annual 
plans for the next fiscal year scheduled for submission early ne^t year. 
We are hopeful that the second annual plans will be much better than the 
first set. Your suggestions for improving these materials will be appre- 
ciated « 

Neither the governor nor the legislature has mandated PPB for North 
Carolina, nor has either of these publicly commenced on PPB* The state 
budget division has been aware of it for nearly three years and this 
spring took the first step to move the agencies into itc In July of the 
even-numbered years, when the legislature is not in session, each head of 
a major agency makes a presentation before the Advisory Budget Commission, 
outlining his agency's hopes and dreams. This year, instructions from 
the budget division contained a PPB flavor, emphasizing long-range plans, 
goals, and tar/',et groups, rather than the previous emphases on agency 
maintenance ano line-item categories. The July 3 presentations by the 
State Departmert of Public Instruction and the Department of Community 



6 



Colleges were well-received and showed evidence o£ compl et.e Iv understand- 
ing the shift in emphasis. Prior to this, the agencies ^yare encouraged 
to use their own initiative if they desired to move in iV t PPb direccion. 
Neither the State Board of Education nor the Deparcme.yX of PudIlc Instruc- 
tion has taken a position in support of PPB, leaving the Di\/ision of Occu- 
pational Education and the Department of Community Colleges with no coni- 
mitment from "above." As project director, this left me wir.:h persons 
interested in making a start, but who were given f^^w r/:.source3 to devote 
CO it and no push from within the agency. 

The conference presentations and materials will ue.lj you what we 
have done, what we have not done, and what we ought to have done., with 
emphasis on che latter. We have purposely omitted topics on techniques 
of projecting maiipower requirements, conducting benefit/cost studies, and 
displaying alternate programs and their associated costs. Most: of you 
have been exposed to these topics at prior conferences and have materials 
explaining them in your office library. We have chosen., inst^-^ad, to con- 
centrate on first things: obtaining the necessary political and admini- 
strative support, deciding the directions in which the total system 
should move, establishing a management information system, and scheduling 
PPB implementation activities. Work sessions have been scheduled to pro- 
vide opportunities for each participant to develop or refine planning 
materials for use when returning home. Some of you may have brought such 
materials with you with the intention of reworking them during the work 
sessions. Others may be starting from scratch. Rather than providing a 
canned problem to keep you busy, we have decided to let you choose your 
own weapons. You may work individually or in groups. 

If you haven't already browsed through the package of materials we 
provided last night, I recommend you do so before this afternoon's work 
session begins. Many of the pages are miscellaneous items I wrote when 
particular questions arose, such as the sheet titled "Criteria for a Mini- 
mum Comprehensive Program." I heard the terms "comprehensive high school" 
and "comprehensive program of occupational education" used but not de- 
fined, so I took a crack at it. Another sheet refers to policy questions 
which arose as we attempted to plan--questions which had not been answered. 
You are free to ignore, cbpy, or modify these things. 

Finally, we have invited the state staff at both the secondary and 
postsecondary levels to sit in on the presentations. A roster of their 
names, office locations, and telephone numbers has been included in your 
package of materials, should you wish to conduct business with them while 
here. We solicit your active reactions to the project and its conference 
activities, whether they be supportive or adversely critical^ We are all 
still learning. 
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LAYING THE GROUNDWORK FOR PLANNING, 
PROGRAMMING, AND BUDGETING 



Mercer Doty 

Budget Division 
North Carolina Department of Administration 

It might be helpful to begin this presentation by saying something 
about where we are in North Carolina with respect to pianning, program- 
ming, and budgeting. Several agencies of the state have ini^'tiated work 
that has taken them well along the planning, programming, and budgeting 
trail. We are here today to talk about one of these efforcs--in occupa- 
tional education. There are a number of others. However, the central 
budgeting and pl^nn^ng offices of the state are not corimitted to planning, 
programming, and budgeting, nor do we have such a commitment from the 
governor or from the director of the Department of Administration. The 
state still uses a line-item budget prepared for two-year periods and 
approved by a legislature that comes to town for six months or so every 
other year. The relative power position of the j^overnor with respect to 
the legislature Is quite weak. He has ro veto of any Kind, and he cannot 
succeed himself. With a strong legislature or general assembly, which is 
usually absent, and a weak governor who is usually present, you might 
wonder how the state operates. Most of the money decisions required in 
the absence of the general assembly are made by a group of six men called 
the Advisory Budget Comm:^* ssion. The Advisory Budget Commission is essen- 
tially a standing committee of the general assembly because four of its 
six members are the chairmen of the house and senate money committees. 
The other two members are appointed by the governor. Therefore, the dis- 
cretionary money decisions that must be made in the absence of the gen- 
eral assembly are made by the Advisory Budget Commission. At the risk of 
being facetious, it may be pointed out that the Advisory Budget Commission 
is not committed to planning, programming, and budgeting either. 

With this brief background on the status of planning, programming, 
and budgeting in North Carolina, we might consider changing the title of 
this session from "Laying the Groundwork for Plarrning, Programming and 
Budgeting" to "Scratching the Surface for Planning, Programming, and 
Budgeting." Such a change would be appropriate if we were to consider 
only those measures of progress applicable to state government in general. 
However, we are fortunate that we have some individual agency efforts that 
are quite advanced — and that is why we are here^ Even though we cannot 
compare in general commitment to Wisconsin or Pennsylvania and others, we 
can say with some pride that we are trying ex^erything in our attempts to 
"move the mountain." 

So much for general background on North Carolina. Now let's 
consider for a moment the nature of planning, programming, and budgeting. 



It reminds me of "the cycle of poverty" in some rfisc^-rv- cs , Thar e, .pres- 
sion has become popular among sociologists because ic r f:Cog:ri2es the 
self-perpetuating nature of poverty. In talking aboat ii. r.h^y draw a 
circle to represent it and emphasize that this circle^ or cvcU', must 
be broken at several places at once if we are to have any real, effect 
on poverty,, The same applies to planning, programming, and t^udgeting. 
The top man cannot proclaim it and have it blossom orernight. The 
planner cannot do it alone; the budget man canV. either; nov can the in- 
formation specialist or the systems analyst or the cost analysts Plan- 
ning, prograrnming, and budgeting requires the under stavHiing and support 
of several of these functions if it is to get off the grounds This is 
why virtually all of the planning^ prograrnming, and budgeting literature 
emphasizes the need for support from the top — because this is one way 
of ensuring support from other staff functions below th^^ top* 

Where is "the top"? Ideally, it is that point af. which control 
is exercised over all the key actors in the planuing^ programming, and 
budgeting drama* In practice it is often difficult ro get a commitment 
from this man, and in this connection we should rerrember that the 
higher we go up the ladder of responsibility, the greater become the 
constraints « So we must sometimes settle for strong support somewhere 
below the ideal "top man." This will make the job tougher but not neces- 
sarily impossible^ It will increase the need for diplomacy, selling, 
and education, We should take care to teach and to rell those groups to 
whom the top man is responsive. If we can change their attitudes we can 
reduce the constraints on them and make it possible for them to change 
their attitudes without undue risk* In the business of teaching and 
selling we can also draw support from the efforts of other agencies « 
If you have a red-hot planning, prograroming, and budgeting project under- 
way in another agency, keep in touch. It is a good source of help in 
the techniques of planning, programming, and budgeting and their success 
can increase your own leverage. We have a rather sophisticated informa- 
tion system under development in the Department of Mental Health* They 
are doing a good job and we shout it from the roof tops. We also keep 
a steady stream of state employees knocking on their door^ The same 
applies to the planning underway in the Department of Community Colleges. 
You will hear more about this on Wednesday. Don't think for a minute 
that we're the only ones who know about this conference on planning, pro- 
gramming, and budgeting in occupational education o A lot of people in 
Raleigh know about it, many of whom won't touch planning, programming^ 
and budgeting with a ten-foot pole - yet I 

Nov/j let's talk a bit about planning. There are several strate- 
gies that can be used to get the job done. One of these might be called 
the "broad participation strategy." In this approach large numbers of 
agency people are involved in the identification of goals and objectives. 
It requires a large staff and a lot of man hours at many levels in the 
agency. It also requires a massive teaching job so the many people in- 
volved are launched in productive directions. This strategy has the 
advantage of producing plans that have built-in acceptance. It is diffi- 
cult to execute, and it requires a staff with consideratle sensitivity 
and skill. 
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The second scraccgy can be done by a small. sLaff in a compara- 
tively short time. This strategy is easier to contirol and execute, but 
it requires more selling when the job is done. 

Row do you kno'v\- which strategy is best for you^'' In ansvTering 
this question^ look at the resources controlled by the highest admini- 
stracor in your agency who has made a positive commicment to planning, 
programming, and budgetings If he has plenty of resources, you might 
consider the first strategy. If he can only make available one man and 
a secretary, you mighc be better off with the second rauTiBo Consider 
also the time assailable. Maybe the use of a consultant can augment 
your staff enough to get the job dene. Above all, look at the kind of 
organization you're working with and the professional biases of your 
field o In your situation you may want to develop a modified stra'tegy • 
that is somewhere in between the two we have discussed. Even with a 
small staff effort it may be possible, and to great advantage later, to 
keep people informed of what is going ou. This, of course, applies 
especially to activities that will be effected as planning develops, 
such as budgeting and data collection. How you handle, your contacts 
with these related activities depends to some extent on the nature of 
the commitro.ent from your top administrator and on his level in the organ- 
ization ''pecking order." The stronger his position on either score, the 
less diplomacy vyill be required^ It is probable that the top adminis- 
trator does not exercise control over the budget process so it is essen- 
tial that the planner recognize early what he can expect (or cannot 
expect) in the way of budgetary reform. Another activity that is often 
overlooked is the accounting system* If yours has not recently been 
overhauled, it is probably inadequate for program accounting. You may 
be able to stimulate change in the accounting system^ but it is more 
likely that you will have to adjust to it the way it is. This may re- 
quire you to insert an extra step in your budget to translate your pro- 
grams to other cost categories that the accounting system can handle^ 

It is obvious that the identification of goals and objectives 
must have high priority. However, the. phasing of some of the other tech- 
niques of planning, programming, and budgeting may not be quite as 
.obvious. No one can give you an exact sequence because so much depends 
on the degree of development of these techniques in your states and on 
the degree to which they are accepted by policy-makers « On the other 
hand, keep in mind that the beginnings of planning, programming, and 
budgeting, even in the enormous Department of Defense^ were small. Hand- 
out #1 lists the prerequisites that made it possible to install planning, 
programs .ng, and budgeting in the Department of Defenseo Thi.s is a 
reminder to us all that our expectations have grown over the years. 
Handout #2 lists some of the techniques of planning, programming^ and 
budgeting with comments on each that may be helpful in identifying and 
scheduling the tasks ahead. ^ 

There are a few comments that might be made about the constraints 
under which you- must operate. The first are the most obvious-apolitical 
constraintsc The way the political winds blow vaill vary greatly from 
state to state, but they are" always there. You must be sensitive to 
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chem simpj.y because, you cannot expect to sell an idea to a political 
official If: he expectij to lose, voces as a resulc of it. Re^aecnber , it's 
his perception of public attitudes that, counts, -aox yours. Very few 
politicians take calculated risks* More oft^n, they ' overestimate the 
opposition of the smallest interest groups ar.d overr''::act to it. This is 
bad news^ but vfi have to live with it, Thiri does not mean that we. should 
avoid elected officials and their appointees, but that we should select 
our targets with great care. Put a lot of effort in identifying the real 
key people. Dorx't sell when there is no need,, but snil as though your 
life depCTds on it when an official is on your target list. 

In the selling game you will run up against men who oppose your, 
ideas for a variety of reasor^.£. Some will block you as a result of 
their ignorance or misunderstandiiig. Their attitudes cai^. usually be 
changed if they develop confidence in you .and, i.f you patiently, correct 
their misunderstandings- Some officials will oppose you. merely because 
they fear change of any kind. These are generally tough eu,«tomers be- 
cause they may agree with you publicly and; fight you.in- private, - If you 
know the maxx well, you may be able to change him^ If not, look around 
for someone, else who can change his attitudes, like his boss. Of course, 
there are some individuals who see that planning., ' programming j and budget- 
ing wall threaten their^ positions As a group they are not stupid, and 
this is to your advantage. They may be bright ■ enough to learn how they 
can achieve rewards and satisfaction within a planning, programming, and 
budgeting system. It will be xwrth a try to teach, them/ The toughest . 
job of all may be to identify which of the opposition is basing his stand 
on which of the reasons we have discussed. He tells you he. thinks, plan- 
ning, programming, and budgeting is unsound because it concentrates too 
much power in the hands of a few analysts. Is this vrhat he really thinks, 
or did he read it .in Ann Landers' column? 

By now you must be wondering just what; the role of the planner is. 
He has many roles o He must be a leader who shows the way. He must be a 
prodder and a pusher. He must be a teacher in the morning and a salesman 
in the afternoon, andj/like those 'Vrho also serve/' he must often ^'stand 
and wait/' Remember that PPE can .also' be an acronym for Patience, JP^rod- 
ding, and Blackmail c To do all of these things you m.igh.t think you have 
to be a combination of Mi.l'ton Friedman, 0, Jo Simpson, and Bob Hope. It 
would help, but there are some specific talents that we lesser men can 
use. We need cQmpecence most of all — to adapt planning, programming, and 
budgeting to our ovto environments and to understand why some very thought- 
ful m.en have reservations about its effect on some of our institutions* 
We must know how-to deal effectively with people from the governor to the 
janitor — ;how to organize them and- how to re'late their specif i.c talents to 
the tasks at handg We need to know how to plan in the field of occupa-- ^ 
tional education and how to plan the implementation of planning, program- 
ming, and budgeting. 
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HANDOUT #1 

PREREQUISITES FOR TF^ INITIATION OF PPB 
IN THE DEPARTMENT OF DEFENSE "^ 



1. A small group of talented people who had spent years developing in- 
sights into the special problems of defense strategy and logistics. 

2. A common terminology, an ad hoc collection of analytical approaches 
and the beginning of theoretical statements to guide policy analyst 

3. Top leadership that understands policy analysis and is determined t 
get it and make use of it. 

4. The existence of planning and planners. 



^Taken fr om Public Administration Review , March/April, 1969, 

p. 191. 
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HANDOUT #2 



ACTIVITIES RELATED TO PPB 



I. Determining Goals and Objectives 

Comments: This is essential to both the mechanics and the under- 
standing of PPB* As a prerequisite it requires a mission statement 
that gives the major priorities and broad goals of occupational edu- 
cation. It is useful to attempt to express objectives in terms of 
some service provided (or skill taught) to some segment of the popu- 
lation. In developing objectives there will often be a need to re- 
vise or amplify the mission statement. 

Phasing: Usually the initial step. Priority I 

2* Program Definition 

Comments: Once objectives are established, the activities that con- 
tribute to their achievement can be identified. These become the 
elements of a program to reach an objective. Program definition is 
a two-phase process. One part of it deals with what is going on now 
that contributes to your objectives. The second part of it deals 
with what ought to be done to achieve the objectives more quickly, 
effectively, or economically. This is where alternatives are born 
and why they must be evaluated. 

Phasing: Begins as soon as you are reasonably satisfied with objec- 
tives. Continuous process with respect to future years. Priority I 

3 . Resolution of Policy Questions 

Comments: Policy questions will surface during the development of 
^ goals and objectives. They must be clearly identified and referred 
as they arise to the appropriate level for decision. Don't sit on 
them or assume policies. The issue paper is one device for resolving 
policy questions. 

Phasing: This is a continuing activity 

4. Building Data for Decisions 

Comments: Data needed for decisions will be identified early on the 
development of goals and objectives. Quantification of objectives is 
desirable as a basis for analysis of alternatives to achieve them. 
Major effort is required to identify and gather required data. With- 
out it, sound alternatives may be eliminated on the basis of inadequate 
data. Need to consider "program independent" data. 
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Phasing: Start early- Whenever a goal or objective is identified 
there must be an immediate determination of data required to measure 
progress toward it* Priority II 

Effectiveness Analysis 

Comments: Cost/benefit and cost/effectiveness analysis are usually 
lumped together because they involve similar skills • However, we 
should realize that cost analysis does not generally require broad 
background in occupational education- Effectiveness analysis does 
require such background. You need professionally qualified people 
to do it well, so you may have to graft the additional analytical 
skills onto people you already have. 

Phasing: Start the development of these skills at the beginning of 
the project. They will then be able to contribute to the data col- 
lection effort early in the game- Priority II 

Cost Analysis 

Comments: The skills involved in analysis of alternatives are among 
the most difficult to get in government* Individuals with compe- 
tence in cost analysis can be obtained through training of employees 
with analytical and mathematical skills or through recruitment of 
new employees. Either route takes time. 

Phasing: Get these skills early. They can have an important impact 
on your data collection effort while they are waiting to begin formal 
cost studies- Priority II 

Identification and Evaluation of Alternatives 

Comments: Once objectives are established, it will be possible to 
identify alternative strategies for achieving them- The evaluation 
of these alternatives will be based on data and analysis. In spme 
instances the level of analytical sophistication need not be high to 
assure sound results. It is essential, however, that alternative 
strategies be supported by good cost and effectiveness data* 



Phasing: Although alternatives can 
their final definition and analysis 
gram objectives. Priority III 

Initial Program Budget 



begin to take shape quite early, 
must follow establishment of pro- 



Comments: This is the first attempt to tie together defined pro- 
grams, objectives, costs, and effectiveness. It will often be im- 
perfect as a result of budget constraints over which you may have 
no control, or as a result of the difficulty of meshing all of the 
activities necessary to produce it. Don't let this discourage you 
Half a loaf is better than none* It is also an important step in 
learning where improvement is needed because it is the pay-off. 
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Phasing: Although PPB is cyclJ^c, the production of the program 
budget is usually thought of as a final step. Execution of this 
budget will reveal its deficiencies, particularly whan projected 
program results are compared to actual results. These in turn be- 
come the bases for revision of objectives, development of new alter 
natives, evaluation of alternatives, and further decisions. Pri- 
ority IV 
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EDUCATIONAL PLANNING 



Joseph A, Perkins^ Jr. . 
Peat, Marwick, Mitchell 6c Co., Accountants 
Washington, D. C . 

Increasing pressures are being felt by state d -par t m-^.nts of edu- 
cation and individual school districts to develop and operatt^. more effec- 
tive programs. The public and the youth of today are. constantly chal- 
lenging educational administrators and planners to search for more effec- 
tive and efficient ways to use available resources 

Recognizing that our educational system has contributed to this 
country's growth and success by such examples as putting men on the moon, 
the almost miraculous successes in the field of medicine, and signifi- 
cant contributions in the areas of fine art, music, and literature, 
what has generated this pressure for more effective programs and the con- 
cern for a better **bang for the buck"? No one thing can be said to have 
caused this pressure. The long-drawn-out Asian conflict, a change in 
values of today's concerned citizens, the frustration of young people who 
see the same mistakes and problems continuing, and the frustrations of 
minority groups with their situation are all factors. 

At a recent visit to a "hippie" commune in northern California, 
the major criticism leveled at the public education establishment was 
that it suppresses communication^ Phrases stood out such as "Daddy is 
home but let's keep quiet because he had a hard day at the office," "No 
noise in the corridors" and "We must have quiet in the classroom," 

Concurrently, hundreds of school budgets and bond issues are be- 
ing turned down by concerned citizens who are demanding better justifi- 
cation of educational costs. Further, they are questioning the effec- 
tiveness of our public programs as they look at the recent college and 
university unrest, "hippie" movements, and the general youth dissatis- 
faction with the established educational system Specifically, planning 
and communication seem to have emerged as shortcomings in our public 
elementary and secondary educational system throughout the country. 

Against this background, local, state, and federal school admin- 
istrators are becoming more cognizant of the need for a more responsive 
and timely system that will effectively coinmunicate the intent of educa- 
tional programs (the output) as well as their costs. You are here at 
this conference as state vocational education planners and program direc- 
tors. You have an additional problem because of the image which voca^ 
tional education has in the eyes of a vast majority of parents and stu- 
dents. This image — that vocational education is for those not bright 
enough to go on to college, for the malcontents in school systems, or 
for those who can't afford higher education--is another dimension which 
planning and communication needs to attempt to solve 
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A planning and program management system that v/ili allow for 
better decision-making and alternative program select ions, and which 
will better assist you in planning, forecasting, and leading the way in 
your states is needed. PPBS (planning, programming, budgt-:!ting system) 
coupled with a greatly improved public relations (cominuuieations) 
approach appears capable of meeting these needs. 

What is PPBS? 

PPBS is a synthesis of established techniques that are applied 
to the management and control processes to produce a program budget that 
relates the output-oriented activities of an organization to the 
input-oriented resources. The advantage of PPBS is that the outputs of 
programs of a local or state educational agency rather than the inputs 
or resources necessary to support them are emphasized. Its value in 
education results not alone from the individual techniques that have 
been developed, but also from theij: integration into a system conducive 
to sound educational decision-making. 

With this system, educational administrators have better informa- 
tion for planning educational programs and for making choices among the 
alternative ways in which funds can be allocated to achieve the state's 
established objectives, the programs to reach these objectives, the 
methods of evaluating the programs, and the costs of operating them. 
The analysis and evaluation central to the implementation of a planning, 
programming, and budgeting system require identification of the public 
school end-products* The analytic and evaluative processes require 
that alternative ways be considered for meeting defined objectives 
through utilization of various combinations of personnel, facilities and 
materials to bring about the desired educational results. The important 
question routinely asked in the course of PPBS operation is, "How much 
additionally would be gained or lost, by way of achieving the defined 
objective, through spending more or less for the purpose?** 

History of PPBS 

PPBS has its origin in the application of systems engineering 
techniques utilized by Dupont Company planners . About 19 16 Dupont 
gained control of General Motors Corporation and wished to establish plan- 
ning and cost controls on the output of the various divisions of General 
Motors. Figure 1 shows the specific progress of the adoption of PPBS 
concepts up to the California project in governmental circles. 

Evolution of Budgeting 

Budgeting, which is a part of the planning and management cycle, 
has gone through an evolutionary process. Figure 2 shows the three major 
steps of the budgeting evolution: object budgeting which deals primarily 
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with the input into a syst^ ra--3alar ies, supplies and materials, equip- 
ment, etc. --and is a controlling device; p erformanc e budget i n,g which deals 
with the process and cd.'i be compared to cost -account mg ; planning, pro - 
gramming, and bud geting K'hich deals with the output or purpose, and pro- 
vides for analysis of alternatives and performance criteria to measure 
attainment of obitcti\n-^ , 



PPBS Concepts and Mi sco nc^-ptions 

There are a number of concepts utilized in PPB systems^ but three 
are particularly imporcanL: 

L, PPBS is a manager.ent tool designed to assist in rational 
dec i s 1 on -mak i ng , 

2, PPBS provides an. ordered way of examining problems of choice. 

3. PPBS pros'ides a means of presenting teachers and administra- 
tors a defined course of program activity^ time-phased over several years, 
with built-in provisions for continuing assessment of program progress. 

There are some misconceptions about PPBS which continue to prevail 
and have frequently conrributed to unsuccessful implementation in agen- 
cies. They are; 

1. PPBS is not a substitute for the experience of the decision- 
maker . 

2 PPBS is not decision-making by computer ; 

3, PPBS is not limited to budgeting and cost accounting. 

Unfortunately, some administrators and many state and local school board 
members envisage PPBS as a kind of "instant management Metrecal" which 
will provide them with instant answers. Others are frightened by PPBS as 
a step toward relinquubing ail decision-making to a computer. Neither 
is truel As previously stated^ a PPB system ii a management system 
which will assist the d&: i sion-maker , not supplant his experience. Simi- 
larly, one needs a computer only because there is a large volume of data 
to process, and the computer can only array this data in various formats 
in order that the administrator may then analyze the results and make his 
decision. 

Finally, It is important to stress that PPBS really requires a 
change in management thinking and behavior. It is necessary to manage 
the inputs into a system, but in addition, we must constantly be planning 
for results, assessing rhe effectiveness of program results^, and deter- 
mining new or different ways to achieve desired goals. Budgeting and 
cost accounting are only two of a number of supporting techniques to PPBS 
rather than the endpoints, 
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The Elements of PPBS 



The elements of PPBS are perhaps best understood when presented 
in terms of the PPBS cycle- The schematic diagram of the cycle (Figure 
3) reflects the following features which will be discussed in fuller 
detai 1: goals, objectives, programs, budgets, opera c ion, evaluation, 
analysis, and the supporting management information system. 

These elements are essential to any PPB system regardless of the 
level of operation, local, state, or federal. 

Goals and Objectives 

In order to introduce the reader to goals 'and objectives. Figure 
4 shows examples of non-educational and educational goals and objectives 
in a simplified form. 

In order to determine the goals of an agency or a division of an 
agency, such as occupational education, the needs of the state must first 
be identified. These are the needs of the children, adults, business, 
industry, othe.r governmental units, and all of the other societal ele- 
ments of the state. These needs must then be translated into goals or 
general statements of purpose or intent. Goalr are not related to a spe- 
cific period of time, and they are not quantifiable or measurable in any 
way other than by a broad subjective review,. Examples of goals are shown 
in Figure 5. These goals should then be arranged in hierarcnical order 
and structure as shown in Figures 6 and 7. 

Objectives, which are desirec quantifiable accomplishments within 
a time framev^ork, must next be developed. The relationship between goals 
and objectives is shown in Figure 8. Each objective must: 

1. relate to one or more goals^ 

2. be measurable, 

3^ state the method of measurement, 

4. indicate the evaluation criteria, and 

5. state the time period for achievement. 

Some examples of objectives appear in Figure 9, and arrangements of objec 
tives in hierarchical order and structure are shown in Figures 10 and 11, 

Objectives, then, represent measurable achievements, the attain- 
ment of which advances the educational system in the direction of estab- 
lished goals. Integral to meaningful objectives are the evaluative cri- 
teria by which the effectiveness of programs in attaining objectives will 
be measured- It will be observed that each of the objectives shown as 
examples contains within it one or more stated or implied evaluative cri- 
teria. 
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A management information system responsive Co the needs of the school 
system^ the State Department, federal government, and other county 
agencies. 

A financial system that supports the overall management information 
system. 

To provide prog^ram cost data for all county school system programs 
and activities. 

To provide program and cost data for Vocational. Education programs. 

To provide program and cost data for Distributive Education programs. 

Figure 6. Goal Structure (Example) 
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By July 1, 1972, have all systems of the Educational Management 
Information System operating in order to provide the information 
needs of PPBSc 



020-^ By July I, 1971, have all subsystems of the Financial System 
designed, tested and operating. 



^3^1 -July 1> 1970, have operating the program cost accounting 

subsystem of the Financial System for all county school programs 
and activities by object and responsibility unit. 



^4^1 J^ly ^9 1970, be able to provide monthly reports for Vocational 

Education displaying subprograms operating costs by object and 
responsibility unit* 

^5^1 J^^y 1> 1970, be able to provide monthly reports for Distribu- 

tive Education displaying program operating costs by object and 
responsibility unit ♦ 

Figure 10* Objective Structure (Example) 
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FOR NINETY PERCENT OF THE GRADUATING SENIORS THAT WISH TO ENTER THE 
IA60R FORCE TO GAIN EMPLOYMENT WITHIN THREE MONTHS OF GRADUATION 
AS MEASURED BY A DISTRICT SURVEY 

FOR NINETY PERCENT OF GRADUATING SENIORS THAT WISH TO ENTER THE 
LABOR FCr^CE TO GAIN EMPLOYMENT AS OESIRCO IN BUSINESS, OR AGRICULTURE 
V/ITHIN THREE MONTHS OF GRADUATION AS MEASURED BY A DISTRICT SURVEY 

FOR NINETY PERCENT OF THE BUSINESS CURRICULUM STUDENTS TO MEET 
THE FOLLOY/ING STANDARDS; 

o TY^'!15 -* V/ORDS PER MINUTE AS MEASURED BY THE IBM TEST 
WITH 90 fcRCENT ACCURACY 

o SHQ PJHANO - 60 WORDS PER MINUTE AS MEASURED BY THE GREGG 
TEST VniH A 2000 WORD VOCABULARY 

^ BOO KKEEPING - DEMONSTRATE UNDERSTANDING OF JOURNALS^ - 
INCOM£ STATEMENTS, AND BALANCE SHEETS AS DETERMINED BY 
CiAS^ROOM TESTS 

o Crn CE MACHINE OPERATION - MEAN SCORE EQUAL TO NATIONAL 
AVERAGE ON NCR TESTS 

UPON COURSE COMPLETION NINETY PERCENT OF STUDENTS WILL BE ABLE 
TO ACCOA^PLISH THE FOLLOV/ING BASED ON CLASSROOM TESTS : 

• STATE AND UNDERSTAND THE BASIC ACCOUNTING EQUATION ' 
OF DOUfME ENTRY BOOKKEEPING 

• UNDERSTAND THE FUNCTION OF AND MAKE JOURNAL ENTRIES ' ' 

• UlJDtPsSTAND THREE OtPFXClATION CALCULATION K\ETHODS 

F5 gure l.i . Typical Object i ves Structure 
30 



Measuring program effectiveness will probably be the most diffi- 
cult problem encountered in the development of a PPBS at the state agency 
level. Your measures of effectiveness will have to deal with what pro- 
gram leadership, quality control, and other state functions can be effec- 
tuated with local school districts. It is recognized that there are 
areas of the educational process which are not, and perhaps some which 
cannot be, evaluated quantitatively. However, most of these unique or 
special areas can be subjectively evaluated, and documented subjective 
evaluation should be required. PPBS holds the promise of compelling edu- 
cators, psychologists, and administrators to effect a breakthrough in the 
measurement log jam. 

Two examples, important at the state agency planning level, of the 
relationship of educational goals and programs are shown in Figures 12 
and 13. 



Programs and Program Structure 

When the goals, objectives and criteria have been defined, the 
next step is to develop programs that will attain the objectives. A pro- 
gram is a group of interrelated activities directed toward accomplishing 
objectives. The programs are arranged in a program structure, a hierar- 
chical arrangement of programs that demonstrates their relationship to 
goals and objectives. 

The majority of programs currently defined in most school dis- 
tricts are in the basic educational disciplines. The often extensive 
documentation of these programs is in the form of curriculum guides and 
course outlines. In most instances, this documentation with relatively 
little modification will provide the program description required for the 
PPBS. 

There are usually no formal program structures covering the total 
activities of school districts. Minor rearrangement of the existing 
curriculum guides and class outlines will usually provide the basis for 
program structures within the basic educational disciplines. For example, 
under business education there are often program subcategories for typing, 
bookkeeping, shorthand, and office machine operation. For areas other 
than basic education, programs must be defined and organized into such a 
program structure. 

The elements of a program structure are regularly identified as 
the following: 

1. It provides a framework for program planning. 

2. It will group educational activities to show how they relate 
to the achievement of objectives. 

3. It will allow tracing of goals and objectives through all 
levels for program evaluation. 

4. It provides a framework for budgeting and cost accounting. 
O 31 
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A sample program structure for a local school district is shown 
in Figure 14. Several state departments of education have developed well 
defined program structures for their operations. Because of the unique 
leadership role state departments of education have with local educa- 
tionaJ agencies, care must be taken to provide continuity between local 
and state agency program structures. This role is distinct and different 
from other state agencies which actually operate programs or manage 
activities such as highways or recreational programs. 

For PPBS purposes, the programs and the analyses supporting them 
are documented in program memoranda. A program memorandum covers one 
major program area or portion of a major program area and presents alter- 
natives considered, specific findings, recommendations, and cost esti- 
mates extending over the anticipated life of the program. At this point 
alternative programs are examined and selected in the light of constraints 
imposed by resource limitations. 

Budgeting 

Dollar figures are incorporated into two documents— the multi-year 
financial plan and the program budget itself. 

The multi-year financial plan presents financial data for existing 
and alternative programs projected over several, usually five, years. 
This is a departure from the current practice of developing budgets for 
only the following year. The program budget itself, which pertains to the 
forthcoming year (or other budget period) only, is a statement of policy 
thac relates costs to goals, objectives, and programs, based upon a pro- 
gram structure classification. 

Operation 

The next activity in the PPBS cycle is the actual operation of the 
programs and the management of the resources to implement them. These 
resources are, of course, the people, places, and things--the staff, 
buildings, supplies, and equipment. 

Evaluation 

The final step in the cycle is to evaluate the . effectiveness of 
the program operations against the criteria established for the various 
program objectives. The process then recycles, using the evaluation in- 
formation to determine whether objectives were attained or were not attain- 
able because of either program or resource limitations. 

A PPBS system is a continually active process. The effort to 
initiate a system requires that all current programs aiad activities be 
subjected to this systematic, analytical process. As ineffective pro- 
grams and activities are purged from the system, their replacements are 
subjected to the same analysis. 

34 
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Conclusions and Benefits 



Efforts to date in implementing PPB systems in state departments 
of education have been fragmentary and incomplete. One problem which 
continues to cause concern deals with the desire to discard the typica'' 
function/objecf: line item budget in favor of the program budget. The 
legal fund accounting by function and object inust be continued as one 
product of the financial management system. A program budget is an 
additional dimension to the budgeting and cycle which provides informa- 
tion on outputs not available from the line item budget. 

Through the use of a PPB system, a state agency can be better 
prepared to demonstrate to the public, the executive branch, the legis- 
lature, and local education agencies the effectiveness of programs and 
the prudent use of resources available. PPBS provides a new approach to 
an old problem--that of better utilizing our limited resources to improve 
the learning process, 
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INTEGRATING PLANNING, PROGRAMMING, AND 
BUDGETING CONCEFIS WITH OFFICE OF 
EDUCATION REQUIREMENTS 



Cliff Belcher 

Division of Occupational Education 
North Carolina State Department of Public Instruction 

In preparing this subject, I have tried to establish five major 
headings under which to cover information. They are: 

1. what the present reporting requirements for occupational edu- 
cation are; 

2. what seems to be on the horizon for tha U. S. Office of Edu- 
cation reports; 

3. what North Carolina has not done toward integrating planning, 
programming, and budgeting concepts with Office of Education 
reporting requirements; 

4. what North Carolina is considering in response to Office of 
Education alternatives; and 

5. what ought to be done. 

Basically, when we begin to discuss this topic, we are talking 
about the implementation of a part of a total management information sys- 
tem; however, in order to approach the subject at hand, let me start by 
talking about the present reporting requirements of the Office of Educa- 
tion . 

We need to discuss a little history at this points Traditional 
reports prior to the 1968 Amendments were: 

1. the financial, which indicated the expenditures by program 
and purpose; 

2. the statistical, which was reported by program area; 

3. the follow-up, which is really the key in PPBS and which 
covered the old program areas; and 

4. the descriptive report. 

The relationship of these reports to the State Plan has been 
relatively insignificant in the past. The post-1968 reports, however, 
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have shown considerable promise beyond what existed at one time. A 
group specially established by the U. S. Office of Education began work 
in January, 1969, to develop forms which would relate to or tie into the 
State Plan for Vocational Education and would also have some meaning for 
the planning, programming, and budgeting system. Forms were developed 
which closely followed the PPB concepts; therefore, making it possible 
for the reporting system to become the fourth phase of the State Plan 
for Vocational Education* It would be a simple matter to tie back to 
Parts II and III of the State Plan. These forms were completed and 
recommended to the U. S. Office of Education. They were accepted at 
that level; however, when the forms were recommended to the B'ireau of 
the Budget, modifications were made by that agency to the extent the re- 
porting requirements for fiscal year 1970 are going to be practically 
useless if the state should restrict itself to the modified format. In 
essence, what has happened is that we have returned to the old tradi- 
tional requirements. This brings us basically to the question, what are 
the U. S. Office of Education's needs? I believe Pete Perkins touched 
on this in his presentation to you earlier, and I do not propose to 
debate this particular topic at this point. 

Instead, I think we need to move to the se' -^>d major topic, what 
seems to be on the horizon for U. S. Office of E- wion reporting* 
Based upon my limited knowledge, it seems th^it tVi- :: are three major 
influences "leaning" on the Division of Vocational and Technical Educa- 
tion reporting desires. They are: 

lo The Bureau of the Budget - All report forms must be approved 

through this agency. There is a strong tendency to restrict the Division 

in meeting the requirements which Vocational and Technical Education 
feels that they need. 

2. The Center for Education Statistics - Based on recent infor- 
mation received from this agency, it seems that they w«ant a directory of 
vocationc^l education. This, in essence, gets down to the nitty-gritty 
of knowing exactly what is being done as far as programs are concerned 
in each high school by each high school, by each teacher in each state. 

3. The third group which seems to be coming into relative promi- 
nence at this particular time is the "Belmont Group." This group pro- 
poses to make vocational education a part of its master plan and to 
implement vocational education into this plan in 1972. Based on the 
proposal presently being constructed, a core of financial and statisti- 
cal data will be secured by the Division of Vocational and Technical Edu- 
cation. The remainder of the information necessary for vocational edu- 
cation will be done on a sampling basis through the documents commonly 
known as the CPIR being proposed by this particular group. 

Which of these alternative directions will win out? Based on 
previous history, there is a good possibility that the reporting require- 
ments will develop into a multi-system with duplications continuing; 
therefore, the state can no longer use the U. S, Office of Education re- 
porting requirements as a basis for designing, reporting, and management 
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information data banks at the state le^el . Instead, we. must look at 
state and local needs and glean from this the reports requested by the 
U. S. Office of Education. 

One of the tremendous difficulties in integrating program, plan- 
ning, and budgeting concepts with Office, of Education reporting require- 
ments is the fact that reporting requi rements are shared with states on 
an annual basis, and generally these reports come so late in the fiscal 
year that if the state does not have a true management information system, 
it is impossible to secure the data required by the U. S. Office of Edu- 
cation. 

This leads us into what North Carolina has done Since North 
Carolina is unique in that there are two systems of vocational education^ 
one existing at the Department of Connmunity College level for post secon- 
dary purposes and the other at the secondary level for elementary and 
high school purposes, it will be necessary for me to address myself to 
them separately. 

The Secondary System 

This system is undergoing a complete change in its reporting sys- 
tem. This has occurred primarily because of administrative changes in 
the Department of Public Instruction, In the past, the secondary re- 
porting system has been established based upon U. S. Office of Education 
requirements. The basis for reporting was established at the local level 
with reports flowing from the local teacher to the program areas at the 
state level and to the Division of Vocational Education, Assistant Direc- 
tor's office, for compiling with Community college reporting figures and 
subsequent submission to the U. S. Office of Education. The secondary 
level has been using a non-machine process, requiring everything to be 
done manually. Two years ago, the State Board of Education indicated 
that the existing system was placing too great a burden on teachers and 
directed the Division of Vocational Education to study reporting require- 
ments and raduce them t^ the absolute minimum. Action was taken. Reports 
which at one time had been collected monthly were reduced to three times 
per year. Other changes occurred in the reporting system, also. On 
October 1, 1969, reorganization of the Division of Vocational Education 
basically did away with the program sections and assigned the function 
of collection of data to the Assistant Director's office. This completely 
eliminated channels for reporting in midyear. Therefore, it was neces- 
sary for us to scramble this year, and actually we fell flat on our face 
since the established channels for years w^ere disrupted. The uncertainty 
over the kinds of information which would be required by the U, S. Office 
of Education also quadrupled the pressure and confusions^ not only at the 
state • level but also at the local level . 

The new reporting isystem being designed proposes to implement a 
format whereby individual forms will be collected at the local level by 
students. Then the teacher at the local level will complete an optical 
scan form summarizing the data collected at that level by category and 
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foncard this to the state office to bs processed.. This .^yscem will 
probably provide tables of every possible type of information the U. S. 
Office might require. It also will provide extensive ir? formation to 
the Division of Occupational Education for the purpvise ot planning and 
•progrannining occupational education programs at zhe eiem^ii>.tary and secoH"- 
day level in this state. It is presently proposed that this system 
will be implemented in t-he public school program during the coming school 
year . 

The Post secondary Level 

The reporting system for several years has been done completely 
by machine. The postsecondary program has been through several stages 
now» Firfiit, they went through the summary stage from local educational 
agencies, and they found the reporting data to be extrem^iiy inaccurate. 
Also, this produced a heavy requirement on the instructional personnel. 
The system presently being used in the Department of Community Colleges 
requires each student to supply a core of information as he is enrolled 
in the institution. This card is then forwarded to the Department of Com- 
munity Colleges at the state level dnd processed through computers with 
printouts to the State Department of Public Instruction. The printout is 
definitive to the level of identification by individual students and that 
particular student's information as it pertains to him. This serves as 
an effective base from which many different kinds of tables can be derived 
for management purposes. Much of this information is used for two main 
purposes-- ( 1) planning and programming at the local level and (2) the 
establishment of recommended allocations to local institutions, the latter 
being based upon a full-time equivalency program. 

As for what North Carolina is considering, I have mentioned briefly 
the proposal above for the elementary and secondary education program. 
The community colleges have found their particular reporting system to be 
adequate and propose to continue this reporting system. However, they 
are making an effort to improve the reporting system for thf^ fullow-up 
of students graduating or completing programs from the institutions. 

The state feels that it is on the right road now to what should 
be done in relationship to the integrating of a planning, programming, 
and budgeting concept with Office of Education reporting requirements. 
Basically, the state is moving toward the adoption of the PPBS concepts 
through the establishment of a base system of reporting which will meet 
local needs. This is done on the. consensus that state and local heeds 
are continually much greater than the needs of the U. S, Office of Edu- 
cation, We believe from this approach we will be in a position to pro- 
vide the U. S. Office of Education whatever data they need. This is 
especially true since the unit data which we collect will be on an indi- 
vidual student basis with summaries being forwarded to the Office of 
Educationc This belief is founded on the basis that reporting require- 
ments need to be built around (1) the history of the program, (2) the 
planning requirements, (3) the financial requirements, and (6) the 
evaluation requirements, while at the same time we must constantly be 
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conscious not only of legislative needs but also of needt; of the U. S. 
Office of Education and the Congress of the United States. Therefore, 
in conjunction with the Program Planning and Development Section for 
Occupational Education in North Carolina, four major activities are 
ur der attack; 

1. planning, or the structural design in strategic choices; 

2v programming, or the transformation of strategies into pro- 
grams ; 

3, budgeting, or the allocation of resources and budget dollars, 
and 

4. systems procedures, or an analysis of the evaluation of the 
programs . 

If a proper reporting system is implemented the data will be 
provided for planning, the recycling will show whether reporting has pro- 
duced ti\e. needs indicated through the planning process, and the evalua- 
tion will further show whether the planning, programming, and reporting 
system has been effective. Mr. Doty has furnished you in his presenta- 
tion with a sheet which really indicates the collection in its second 
phase. Therefore, North Carolina is beginning to move on a system which 
it feels will be effective and will meet it.s needs within the 1970' s. 



PROGRAM EVALUATION AND REVIEW TECHNIQUE 



Steven J. Gyuro 

Research Coordinating Unit for Vocational Education 
University of Kentucky 

The initiation of a planning, programming, and budgeting system 
in education is a complex undertaking. The present social, economic, 
and political forces in our society are increasing the demand for a man- 
agement system like PPBS in the fields of education. Vocational educa- 
tion has received special public and governmental attention and has been 
mandated by federal legislation to perform discrete missions with limited 
resources. In addition, evaluation and accountability are very real 
concerns for every vocational education decision-maker. The management 
of vocational education is a difficult task. 

The decision-maker in vocational education at the state level has 
a broadly-based scope of responsibility; a complex organization; diversi- 
fied programs, services, and activities; public and governmental account- 
ability; and the operation of a "big business." The common thread in- 
herent in these factors is resource allocation. Any decision involves 
the allocation of resources. Therefore, management concepts and tools 
are a basic prerequisite for every vocational education decision-maker. 
A planning-programming-budgeting system is one of the new generation of 
managerial tools developed tc furnish the modern decision-maker with 
relevant and timely information for impending resource allocation deci- 
sions. This system does not evolve by chance but must be planned, and 
its initiation managed^ as it is developed and introduced into the 
current conduct of vocational education. Management sciei?.ce has a tool 
designed to assist the vocational education decision-maker in his devel- 
opment, preparation, and introduction of a functional PPB system into 
his organization. This inanagement tool is program evaluation and review 
technique--PERT . The major concerns of this paper are management, PPBS, 
PERT, and how they relate to the introduction of PPBS in a State Divi- 
sion of Vocational Education. 

The purpose of this paper is to discuss management in general and 
focus upon PERT as a tool to assist vocational education decision-makers 
in the initiation of a PPBS. 
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Management 



Definii ion 

Management is an inherent part of all educational endeavors. Edu 
cation is a public institution operated by public resources for public 
purposes, and it requires the highest level of management by educators. 
Vocational education is an integral part of this educataonal institution 
and its growth and conduct are predicated upon good management. Manage- 
ment exists in any organization where resources have to be allocated to 
attain desired goals and where uncertainty and scarcity of resources 
exist . This is the situation in vocational education. Management can 
be defined as purposeful and systematic decision-making Involving the 
allocation of resources to specific means for achieving desired ends. 
Decisions are futuristic. 



Functions 

In vocational education we must ask the questions, What policies 
and goals, what organizations, what means, and what resources? Voca- 
tional education does make attempts to answer these questions, but how 
well? It is through the functions of management that vocational edu- 
cation can answer how well and can take the necessary action to improve 
its operation. The functions of management are planning, organizing, 
directing, and controlling. Through the employment of tools such as 
PPBS and PERT, management is better able to perform these functions. 

Planning is the development of an initial set of decisions 
directed toward attaining specific goals by optimal means. In PPBS this 
involves the assessment of needs, the s^tatement of goals and objectives, 
the exploration of alternatives, the analysis of alternatives, and the 
selection of the alternative(s) to be implemented. Planning is the foun 
dation of all management activity and the building block upon which all 
other management functions are based. Planning is the initial function 
of PPBS and PERT, 

Organizing is directly associated with the number, types of re- 
quirements, and arrangement of people within a social organization. It 
is based upon the development of lines and relationships of responsi- 
bility and authority. In vocational education we are concerned with the 
organization of personnel involved in program services and activities. 
This nanagement function is inherent in the initiation of PPBS and a 
consideration in the employment of PERT. 

Directing refers to the psychological and sociological factors 
involving the interaction of people, especially when that interaction 
is directed toward attaining a group-oriented goal. The directing func- 
tion of management is concerned with the orientation of personnel^ the 
motivation of the people involved, and with leadership activity directed 
toward guiding the staff's activities. Directing is based upon 
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communications. PERT is a tool designed to assist the manager in his 
effort to direct members of the organization in the initiation of PPBS 
because it serves as a communicating devicer 

Controlling is the recognition of deviations from the plan and 
involves the necessary corrective action to ensure goal attainment. 
Controlling is the ability to detect discrepancies between intentions 
and actualities and to take required action for the necessary adjust- 
ments. Control is based upon planning. In this sense, management con- 
trol is the same as evaluation. Thus the adequacy of the plan will 
dictate the adequacy of the control. PERT, in addition to being a plan- 
ning technique, is also an effective controlling technique in the devel- 
opment of PPBS for vocational education. 

The use of PERT will help the decision-maker to plan, organize, 
direct, and control the development and installation of a PPBS at the 
state level for vocational education. PERT is a viable management tool 
for vocational educators in the conduct of their management functions. 

The functions of management in general and the employment of PPBS 
and PERT in particular are concerned with several basic elements. These 
elements are: 

1 . resources-to- means- to- ends relationships , 

2„ people and things, 

3. choices and uncertainty, 

4. evidence and judgments, and 

5. information. 

Managers' decisions appear to incorporate the above-stated ele- 
ments with varying degrees of emphasis. Therefore, it is important that 
vocational education decision-makers be aware of these basic elements 
with which they are continuously involved. 

The re sources-to-means-to-ends relationships provide the general 
context for decision-making. Decisions will involve people and things 
and center around choices and uncertainties. The decision is usually 
based upon some form of evidence and a generous mixture of judgment. 
The vehicle for management^ and in turn for decision-making, is infor- 
mation. Information is the element which allows management to be a 
dynamic process and enables the decision-maker to employ management tool 
such as PPBS and PERT. Without information, one does not have a choice; 
without a choice, one does not have the opportunity to make a decision. 
The objective of PPBS and PERT is to provide the decision-maker with 
better information so he can make better decisions. In this effort, we 
will employ PERT to make better decisions concerning the implementation 
of a PPBS in vocational education. 
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Factors 



In the management of an effort to initiate a PPBS with th^i use of 
PERT, what factors does the. manager have to consider? The manager has 
three factors which he needs to consider and manipulate in order to achieve 
his goal; time., cost^ and performance level. These factors form the 
management triads They are directly related to each ot?ier, and a change 
in one is reflected by a change in the. others. Level of performance is 
a direcc function of time and costc An example is the space program. 
President Kennedy stated that the United States would send a man to the 
moon and return him safely in 1970. In talc cxauiple the time and perfor- 
mance factors were set; the only factor available for the manager to 
manipulate was cost. These same factors are the principle variables with 
which the manager must deal when he employes PERT* Our central focus is 
the use of PERT as a tool to manage the initiation and installation of a 
PPBS for Vocational Education at the state level. 



PERT 

PERT is a management tool used to plan and control a project or 
program^ It basically employs the graphic techniques of network diagram- 
ming. It faciJitates analysis and synthesis of the work involved and 
enables quantitative determinations to be employed. This technique demands 
and forces total project or program planning. The use of PERT by the 
manager provides the following: 

1. definition of the work to be accomplished 

2« specification of outcomes 

3. graphic representation of work flow and inter;:aletionships 

4. estimations of time 

5. awareness of work areas of high risk or uncertainty 

6. resource requirements 

7. cost estimation 

8. output budget 

9. scheduling framework 

10« easy-to-communicate plan of action 

11. basis for organizing and reporting 

12 . basi s for control 
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13. information sources for data base development 

14. structure for implementing change 

The employment of PERT as well as most managerial tools is sup- 
ported with an information system.^ A management information system 
(MIS) meets the extremely heavy demand for information required by plan 
ning efforts r The availability of relevant information will in large 
part dictate the adequacy of the planning effort. 

Planning 

The planning aspect is the first function of PERT. It is the 
most crucial part of any managerial technique or tool„ All subsequent 
managerial actions or decisions are based upon the plan. The planning 
components of PERT include the definition of the work to he accom- 
plished, a work flow graph or network time estimations, scheduling, and 
budgeting. These components are developed sequentially and are inter- 
dependent. The budget is based upon the full development of the pre- 
ceding components. Likewise, the definition of work forms the founda- 
tion upon which the subsequent components are dependent; 

Definition * Project or program definition is the process cf 
determining what is involved and what has to be accomplished- Project 
or program definition proceeds on the assumption that a project or pro- 
gram can best be described in terms of a total system and that the prin 
ciples of hierarchical ordering are applicable and feasible. A system 
is defined as a set of components which are interrelated and directed 
toward the accomplishment of a goal within a specific context. This 
approach enables the project or program to be viewed as a set or series 
of related activities that have to be accomplished to reach the desired 
goalr It is assumed that the goals and objectives can be arranged in 
a hierarchical nature. In addition, the system approach provides a 
basis for establishing the boundaries of the project or program. 

A system analysis approach is used to disassemble the total proj 
ect or program into manageable activities. The analysis may involve 
either deductive or inductive logic.. In either case, the object is to 
determine what is to be accomplished in terms of manageable activ^ities 
and to identify their interrelationships^ This type of analysis will 
yield the work breakdown structure of the project or program. The low- 
est level of the work breakdown structure is termed work package* It 
is a specific set of tasks to be accomplished which will contribute 
one product identified in the work breakdown structure. Thera is no 
predefined level at which work packages will occur. However, they shou 
meet the following suggested criteria: 

1. clearly defined, 

2 . manageable. 
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3. 



short-term (time), 



4. 



have definite start and stop points, 



5. 



communicative, and 



6. 



associated with one organizational unit. 



The work packages should be so defined that they will facilitate 
the development of specifications. These will be necessary to the con- 
tinuation oi the planning process, A helpful technique is to determine 
the inputs needed, the processes involved, and the required outputs or 
products of each work package* 

Work flow network . The network is a graphic representation of a 
project or program and employs the flow graph concepts of arcs and nodes 
which, in PERT, are referred to as activities and events. The network 
functions as a: 



1. 


logical expression of a project or 


program. 


2. 


communicative device. 




3. 


facilitator of planning efforts. 




4, 


basis for controlling, and 




5. 


technique to highlight major areas 


of risk. 



The elements of the network are activities, events, and representa- 
tions of constraints and interdependencies * The activities are obtained 
from the work breakdown structure in terms of the work packages. The 
activities are descriptions of work as represented by outcomes or prod- 
ucts, and they consume time and resources. They are normally written 
with an adjective, action verb, and a direct object (noun). The event 
is a point in time and does not consume time nor resources, but it is 
used as a reference point to describe the start or completion of an 
activity . 



Special network elements are: 

1. dummy activities — to show constraints, 

2. milestone events — to signify a major point in time or comple- 
tion of a major portion of uhe project or program, and 

3. interface events — to designate the event which occurs in two 
or more sub-networks. 



A route through the network is termed a pathway. The pathway 
allows one to follow the logical sequence of activities which results in 
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the completion of a major portion of the project or program or the entire 
project or program. 

The general rules for network construction are: 

1. It employs general computer logic; 

2. There are no alternative pathways; 

3, An event occurs only once; 

4, An activity is constrained by its preceding event; 

5. An event is constrained by its preceding activities j and 

6, Only one activity line exists between any two events- 
The generalized steps for network construction are; 

1. determination of the need for networking the project; 

2. establishment of prime ana supporting objectives; 

3. identification of the totality of work; 

4. development of project definition; 

5. statement of the boundaries of the network; 

6. development of work breakdown structure; 

7. determination of end objectives; 

8. implementation of the approach to network construction: 

9. choice of network symbology and format; 

10. listing of event descriptions - 

ao must represent a clearly definable point of occurrence, 

b. must convey the same understanding to all network users, 
and 

c. must be verifiable ; 

11. listing of activity descriptions - 

a. may represent physical, mental, or administrative work, 
time delay, constraint, or a combination of these; 
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must be sufficiently detailed to identify resources ^ 



c. must be sufficiently detailed to identify responsibili * 
ties fo:: accomplishment, and 

d, must convey the same understanding to all network users? 
12- development of a graphic representation of the network " 

a. general to specific or vice versa, 

b. backward or forward; 

13. choice of written or coded event titles and activity descrip- 
tions ; 

14. employment of accurate interdependency and precedence logic; 

15. realistic application of internal and external constraints; 

16 . accurate interpretation of interrelationships ; 

17. affirmation of amounts of detail necessary; 

itt. critical examination to check for validity and completeness; 

19 V determination of frequency and format for updatii-g; and 

20. acceptance and understanding of network information at all 
levels of project execution* 

Time estimations . Time estimations are the third component of the 
planning process in PERT. There are two types of time estimation — deteri- 
tninistic and probabilistic. Deterministic time estimates are usually 
single estimates baaed upon past experience or valid information. These 
estimates are used when certain activities are familiar or when the per- 
son responsible for the work package or activity has had experience with 
similar jobs. The probabilistic estimate involves two or laore (most 
commonly three) estimates which recognize the uncertainty or risk exist- 
ing in the activity. Either or both kinds of estimates may be employed 
in the network. Time estimates are a function of the activity (perfor- 
mance level) and the resources (costs) applied to it. During this time 
estimation phase, it is assumed that the planned resources will be avail- 
able and used at an even rate of application. 

Guidelines for estimation include: 

1. assumption of a valid activity baj^e; 

2. estimation done by the person responsible for the work; 

3. a basic time frame of a 40-hour week; 



4. estimation of activity time done on the basis "^f random 
selc-ction of activ'ities; and 

5. assumption that estimations will be objectiv/e, valid, and 
reliable . 

After each activity has an estimated time for completion, a series 
of calculations can be developed which will produce earliest expected and 
latest allowable times for each activity, enabling the manager to identify 
the amount of slack available and the critical pathway in the network. 
The critical pathway through the network will require the greatest amount 
of time and also identify the series of activities which will demand the 
closest attention by the manager. The slack designates the amount of 
extra time existing on a particular pathway and informs the manager of 
areas of "free" time which he can manipulate. In addition to time calcu- 
lations, there are statistical methods which when applied to the time 
estimation provide measures of variances. 

If the total time for the project or program is in excess of the 
allowable or designated time frame, the manager has several alternatives 
available to him- He may: 

1. parallel activities, 

2 . reallocate resources , 

3. change the scope of the activity, 

4. change performance specifications, 

5. add resources, and/or 
6c eliminate the activity. 

Scheduling . Once the project or ^ program has been defined, the 
work flow developed, and the time estimations completed, the process of 
scheduling can begin- Scheduling is the translation of the plan into a 
timetable showing the specific calendar dates for work packages and the 
assignment of resources to accomplish the planned activity within the 
specific calendar period. The scheduling process involves the determina-* 
tion of resource requirements, a set of calendar dates, and the arrange- 
ment of activities in a manner that will accomplish trie ultimate goal 
within the resource and time constraints. 

Resource requirements are determined by an analysis of the work 
package in terms of the quantity and quality of normal input (line-item) 
budget items* This includes personnel^ services, communication, and 
other similar items. It becomes evident that the difficulty of this 
task is directly related to the adequacy of the specification of the 
work package defined in the project or program definition component. 
These resource requirements for each work package are then summed across 
work packages to arrive at the requirem^ints for the total project or 
program. 
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The calendar dates for the schedule may be either directed 
(imposed upon the manager) or based upon the work package time esti- 
mates. Normally, dates are directed from some source which will place 
a real and pressing constraint on the scheduling process. In addition, 
limited resources impose another constraint upon the scheduling. 

The scheduling process, or arrangement of calendar dates and 
resources to work packages, will necessitate the following considera- 
tions by the manager: 



1- 


due dates and critical time 


periods , 


2. 


application of resources over time. 


3 . 


sequence of accomplishments, 




4. 


preclusion of serious peaks 


in the work loads, 


5« 


technical limitations. 




6. 


managerial judgments , 




7. 


organizational policies and 


practices, and 


8. 


contractual arrangements. 





It is the concern of the manager in scheduling to minimize time 
and cost, maximize performance, and maintain a level application of re- 
sources and a balanced employment of managerial efforts o The schedule 
can be developed by use of a bar chest format. The horizontal axis 
represents time (calendar dates), and the vertical axis represents place- 
ment of the work package with a consideration of resource requirements. 
The work packages on the critical pathway in the network will, by neces- 
sity, form the major sequence of work. Other work packages will be 
placed upon the schedule as they are influenced by netv/ork constraints, 
amount of slack time associated with the work package, availability of 
required resources, and managerial judgment. 

Realistically in scheduling, time (in terms of dates) and re- 
sources (always limited) will normally dictate changes in the plan as it 
has been developed to this point. Scheduling serves to provide a reality 
frame of reference. It is at this point in the planning process that 
time/cost/performance trade-offs are applied to develop an operational 
schedule of work. 

Budget . The preparation of an output budget is the final compo- 
nent of the planning process in PERT. It is a financi^.l expression of 
the plan. The output budget is a document which relates accomplishment 
to expenditures through a common value (dollars and cents) over time. 
A budget serves both a planning and controlling function of the life span 
of the project or program. 
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It is important at this point that the distinction between input 
(traditional or accounting) budget and output (product or management) 
budget be clear. The input budget focuses upon line item ^^^ntries such 
as personnel, telephone, computer service, etc* This is necessary in 
estimating costs, but it is not meaningful for decision-making by manage- 
ment. Management needs output budgets which relate costs to outcomes or 
objectives. This method of budgeting enables the planner to interrelate 
clearly performance (objectives and work packages) and time (schedule) 
with cost. The budget will provide the information required for manage- 
ment of the project or program. 

The output or management budget is developed from cost estima- 
tions. Cost estimations are based upon input ( line-iten:i) items which 
are directly associated with the previously developed resource require- 
ments for the scheduling component of each work package. In addition, a 
coding or numerical accounting system for the work breakdown structure 
is developed « Each work package has costs estimated in terms of direct 
and indirect costs based upon fixed and variable cost factors. In this 
manner the work package becomes the basic costing unit in an output bud- 
get . 

The costing procedures are similar to time-estimating steps. These 
procedures involve: 

1. costing of single work packages or ac ^Ities; 

2. random selection of work package f sting; 

3. estimation by the person respons:. _ for the task, or job; and 

4. applying the costing concepts of 

a. costing units, 

b. direct and indirect costs, and 

c. fixed and variable costing factors* 

The budget is obtained at any level of work breakdown structure 
by summation of appropriate work packages or costing units. It is also 
necessary to be aware that the budget figures will be influenced by 
manager or planner judgment and contractual requirements. One additional 
point of concern: it is imperative that the control of the budget be in 
the hands of the manager* 

Control 

The. completed plan provides the basis for control in the employ- 
ment of PERT. Control is the ability to detect deviations between inten- 
tions and actualities and to provide the necessary corrective action to 
ensure goal attainment. The relationship of planning and controlling is 
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crucial. The pore detaiU-d, clcar^ aiia precisi--. rhe inirial plan, the 
greater the 'ooti^-c-xial for ^x^f^•:t^ve. and efficient ccncroi. The. concepts 
of change or ad jui Lnjexir prcyv;L:te the framav-ork for Cv^niroip 

The key fac*:oro in control are: 

1, a st3n:lard or criterion base-'-dcr 1 ved from the program defi- 
r'.it.Lo.r and spscificar ions ; 

2, measurement systems--- associated with time schedule, budget, 
and indicators of performance levels; 

3, f e.eJback--re lated to communications and time delays in pro- 
vLd:!ng information for managers; and 

A, dec i sions--action alternatives available to the manager are 
t(.) accept, revise, recycle, rep Ian, or terminate. 

The factors are inherent in the three phases of control. These 
phases include reporting guidelines, management actions, and corrective 
procedures. The focus of each phase is on the elements of time, cost, 
and performance as they relate to the accomplishment of work packages. 

Reporting guidelines ■> Reporting guidelines are unique to each 
application of PERT. The format and content of the reports and their 
scheduling will in general depend upon the nature of the program, the 
manager, and the parent organizat ion ; Reports in any form are a communi- 
cative device They are a means of transmitting information. Reports 
should provide the following types of information: 

1. up 'dating informatj.on for the data base of the MIS; 

2.. specific and accurate information concerning time, cost, and 
performance ; 

3. information focusing on the identification of problems; and 

^ information dealing vnth both process and product. 

Reporting is the information vehicle for control. Sources of 
reports are determined by the location of required information, and 
channels of reporting will be based upon the organization structure and 
policies. However, the responsibility for reporting lies with the pro- 
grara manager, 

blana^e^ent act io n ^ Once the information is obtained, action must 
be taken. The quantity, quality, and timeJinesss of the information are 
critical. The identified problem or deviation from the plan is refined 
to provide a valid basis for analysis. Problem analysis focuses upon the 
determination of cause and effect relationships c Determination of the 
cause of the problem leads the manager to create alternative solutions. 
These solutions will then be tested by some form of simulation to judge 
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their relative ef fectiveness. Upon evaluation of the alternative, the 
manager makes a decision on the alternative solution to implement and 
the course of action tc follow. 

Corrective procedures c The corrective procedures are based upon 
the manager's action and have significant implications for goal achieve- 
ment • Corrective procedures are initiated with the implementation of 
corrective action. This action will result in a modification of the 
initial plan. It is logical to assume that through the course of an 
actual program to which PERT has been applied, many revisions of the 
initial plan will take place before the program is completed or achieved. 
Concurrent with the modification of the plan, corrective procedures are 
needed to provide monitoring of the impact or influence of the correc- 
tive action. It is necessary to determine the direction and magnitude 
of change and how it currently relates to the modified plan. The base 
point of reference for all control action is the goal of the program. 

Summary 

It is through a comprehensive planning and control model like 
PERT that a PPB system can be more effectively and efficiently initiated 
and installed in a State Department of Vocational Education. The com- 
ponents inherent in PERT provide the manager with tools to improve his 
decisions and direct his efforts in the attainment of a functional PPBS. 
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LOC^L-STATE PIANNING REIAT LONSHl PS 



Sherrill T. Goodman 

Director of Occupational Education 
Harnett County, North Carolina, Sc?iools 



The PPB concept requires getting local schools to survey objec- 
tively and analyze their needs, program these needs in a systematic man- 
ner, project and establish priorities, and reflect a reasonable request 
for funds. Good planning requires the involvement at the local school 
level of students, lay people, general education personnel^ vocational 
personnel, guidance personnel, and administrative personnel. 

My function in this conference, as I understand it. Is to relate 
to you in a very practical manner how a county school system attempted 
PPB; how this information was transmitted to the State Department; the 
local-state relationships inherent in the process; and a critique of the 
Handbook planning format, procedure, and allocation of resources. 

The school system to which I refer has ten high schools. The vo- 
cational program included primarily traditional agriculture and home 
economics, with minimal offerings in trade and industrial education and 
distributive education. While the economy of the area changed over the 
years from an agricultural economy to a business-industrial-agricultural 
economy, the vocational programs did not change with the economy and 
mode of lifeo The county school administration and some citizens began 
to realize the need for more occupational education and moved to employ 
a local director for occupational programs. They realized their major 
impediment was a lack of knowledge and expertise in the administration 
of vocational education programs ^ 

It was apparent in the beginning that teachers (vocational and 
general education)^ administrators, lay citizens, employers, and stu- 
dents would need considerable orientation in the process of planning and 
programming occupational education programs. The director of occupa- 
tional education surveyed the situation and oriented county-level admin- 
istrative personnel regarding planning, programming, and budgeting for 
occupational programs. Constant emphasis was placed on two ^'facts of 
life" regarding vocational programs, i.e., they arc expensive, and they 
must be flexible. Once the central office staff began to see, the possi- 
bilities, the local director approached the state office regarding the 
initiation of planning and the use of state resource personnel to assist 
in the PER process* 

A meeting was held with all vocational personnel before the open- 
ing of the regular school session. They were informed that: henceforth 
vocational education programs would be planned at the local level and 

® S7 
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tio'T, Zt va.9 5= u BROS tod t.hat program, offerings sho-jld V'i ba-^ed on stu- 
dcT>t a?r>; ra tlovic and. em;!:loym?.nt d^^ria^^d rar^^cr ^han on the "convenience 
concL 'lo'^'ac i o-s" used in prior yl-anning wi ^h line item, budgets a 

it is V7.1: know;*', in education circle? that the succ:ess or fail- 
ure '>E most educri.c iona I endeavors is cor ting er.t upon the philosophy and 
comjni tment v'>f lov^al adrrirliPtratoro (principals of inciv/idual schools). 
The prln-?ipals ware visited and oriented to the ?.PP> concept and to 
f ede r a 1 an d s t a c po 1 ic per t a [ r> ir,g to voca t i on.a 1 ed-j cat i on . 

Each school organized a planning comrr.itt'-:e, involving at a mini- 
nun/ the fo}los7in.g tvpes of individuals: vocational education personnel, 
the principal; guidance director, at least one gen^^ral education teacher, 
lay citizens, and at least one student. The director of occupational 
education met with each planning committee at least tvrlce to suggest 
procedures and provide orientationv 

Since v7e are approaching this matter in a very practical manner, 
I refer you to the handouts for an indication of our PPB procedure. 
(See Appendix B.) 

The information requested by the Central Office in step six of 
Exhibit 1 provided most of the data necessary for drafting our county- 
level "local Plan for Vocational Education-" 

1 suspect that most of you view this as an extremely simple pro- 
cess. I submit that most of those involved with this type of planning 
at the Jocal level are completely overwhelnied with such a system. They 
do not understand the need for such extensive planning and. consequently, 
are not highly motivated to proceed with implementing the process. It 
x^ras apparent in the beginning that we must make those involved in this 
planning process keenly aware of the need to systematically plan, pro- 
gram, budget, and evaluate vocational education programs. It was also 
apparent that these "local school planners" would need constant counsel, 
advice, and support. We decided that the best way to provide local 
planners with, orientation, support, and advice was to hold a weekly work- 
chop during the planning period • Exhibit 6 reflects the contents and 
procedure for the workshop. The state office gave us tremendous support 
during this period. This workshop provided the articulation vehicle 
among individual schools, the county's central office, and the state 
offic.ec The local director also maintained constant ..contact with Mro 
Belcher, Assistant Director for Program. Operations, and Mr. Builard, 
Associate Director for Program Planning and Devc^lopment . 

Ob servations and Critique 



Local Le. N^el 

Do not presume that local administrators, teachers (general and 
vocational), guidance counselors, and others are lair.illar with the broad 
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scope of vocation?! education, its processes, procedures, regulations, 
policies, and so on. 



Provide adequate clerical assistance. There is much detail and 
minutia involved in this process, and professional-level personnel are 
usually not disposed to perform these tasks at a high and constant level. 

Some "released time" should be provided the chairman and/or 
coordinator of each school planning committee. The process requires much 
planning and articulation in order to be valid and effective. 

The involvement of lay people in the planning process is invalu- 
able in terms of gaining approval of budgets and requests for funds 
(politics, public relations, etc.)- 

The involvement of school personnel (general education, vocational 
guidance, and administrative) is Invaluable in terms of giving them in- 
sight into the need for change, flexibility, and so on.- 



State Level 

Local units should be given adequate time to complete the PPB pro- 
cess in a relaxed manner. 

Perhaps population, labor market, and job opportunities data could 
be provided by the state office. This is particularly a valid sugges- 
tion if there is computer time available. 

The state office should strongly emphasize and suggest to LEA 
chief administrators that local planners must have adequate clerical 
support . 

Each LEA should have an individual who is thoroughly competent in 
the administration of occupational education assigned as a local planner, 
in order for PPB to be effective* 

PPB loses much of its effectiveness unless the chief administra- 
tive officer is thoroughly committed to the process . 

This process loses much of its effectiveness when the State Depart 
ment does not allocate resources, based on planning, in time to be bene- 
ficial to the LEA for its final programming and budgeting. 
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ESTABLISHING A PLA.NNING CONCEFr AND BUDGETING CYCLE 



Harvey H. Fischer 

Spaciai Assistant to the Director 
North Carolina Department of Community Colleges 

My Discussion Will. Include ; 

Some problems involved in state planning 
Our planning concept 
Our plans 

Our proposed planning and budgeting cycle 

Problems in State_ Plannin g 

Creation of a planning staff 

Involvement of staff in planning versus the constant struggle 
with daily problems 

Inadequate information system 

Coordination with other state agencies 

Recognition of political considerations 

Solutions for these problems have not been found, but they are 
under consideration. 

Dro Williams and his study project provided planning guidance, 
coordination with other agencies, and valuable comments on our plans. 

Work has not been completed on the information syst-..i. Input is 
good, but output is almost non-existent. 

Total involvement versus contracting with outside agency to do 
our planning. 

Coordination with other state agencies has been carried out 
through monthly progress meetings and Dr* Williams' work between the 
Occupational Education Division and our department. 

Planning staff has not been created except for one person. 
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Political considerations cause changes to objective and subjec- 
tive planning considerations. 

Our Planning Concept 

First consideration was to eliminate controversial *'sacred cow" 
considerations (Handout #1). 

Following subjects are not included in our plans at this time: 

1. Organization of the system 

2. Lines of authority and coordination between state and local 
levels 

3. Number and locations of institutions 

4. Our system of formula budgeting 

5. Curriculum content and the educational process 

6. Articulation 

7. Accreditation 

8. Admission policies 
9o Tuition 

10c Faculty qualifications and characteristics 

11. Student guidance and counseling 

12. Teaching innovations and research 

A number of these considerations are under study or have been 
resolved in our system. 

What was left: a requirement for an objective planning effort 
that would guide the institutions toward educational programs that would 
properly serve the needs of the people and the economy of the state. 
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Considerat io ns Not: Included in P I a nn in g Effort^ I n i t i. a 1 ly 

1. Organization of the comnunity coJlege system was ^ot studied. 

2* Lines of authority and coordination between state and local 
level were accepted as they presently exist. 

3r Numbers i-^ad locations of i.nstitutions were not examined, 

4» Existing system of formula budgeting was accepted. It will 
require study v7hen, and if, a PPBS is undertaken, 

5. Curriculum content and educational process were not examined. 
The educational process remains with the educator, and it is the means 

of achieving the goals established in the long-range plan^ 

6. Articulation is not included in the planning effort. 

7. Accreditation was not studied. 

8.. Admission policies were accepted as they now exist. 

9c Tuition was not included in the planning effort*, 

lOo Policies on faculty qualifications and characteristics were 
not examined^ 

11. Student guidance and counseling vras net studied but was 
recognized as an area requiring continuing research and innovation. 

12 o Research and teaching innovations are not examined in the 
planning effort n 

Our planning, to date, is based on manpower training needs because 
it is the best method available^ in today's state-of-the-airt , foi esti- 
mating educational and training needs. However , we must never overlook 
the need to meet the complete fulfillment of the individual. Additional 
planning experience should lead us into a broadened concept that wi]l 
allovz us to include "social returns," as well as manpower requirements 
in our future planning efforts « 
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We had to establish these needs, and they became manpower, edu- 
cational, and training requirements p Our planning concept is based on 
the trained manpower needs of the economy of the state during this 
decadeo 

We prepared a concept for a long-range, ten-year plan; a short- 
range, four-year (two bie.nnia) plan; and a model budget for one biennium. 

The plans are based on a population projection and a model of the 
economy during the decade. 

The concept was finalized, and a contract was signed with the RTI 
to prepare our plans. 

Organization Of Our Community College System 
It has three major parts (Handout #2). 

Institutions have a multi-role; 54 institutions offer programs 
shown on Handout #3- Fifteen of the institutions are comprehensive, also 
offering the freshman and sophomore years of college* 

Purpose (or mission) and goals on Handout #4. The goals are not 
quantifiable • 

Our Plans 

RTI's first task was to develop a planning process that would 
include alternatives and a decision-making process (Handout #5). 

Second task .yas the preparation of the population projection and 
the economic model. 

Using this information base and the goals, planning was carried 
out for the ten-year plan by establishing the training needs that should 
be met by our system. Four alternative plans were prepared^ and one was 
recommended to the State Board of Education. 

Decision-making process to include recommendations by the Community 
College Advisory Council and decision by State Board of Education (Hand- 
out #6). 

Extension programs must be continued with the curriculum programs 
and adult basic and high school education^ An order of magnitude is 
indicated on Handout #7, 

Decision by t'\e State Board of Education provided a basis for the 
finalization of all plans: ten-year stratr^.gic plan, the four-year oper- 
ating plan, and the two-year model budgets 
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Four-year operating plan contains quantifiable objectives in the 
form of ^'graduates" from the system- Handout #8 illustrates these objec- 
tives for the statewide system for the next four years 

Information is further broken down by planning areas for the man- 
agement of information. 

Institution Planning 

Final success of the planning effort will depend on the plans pre- 
pared by the institutions. 

Statewide plans will serve as planning models an^l as sources of 
information for. use by the institutions as they do their planning. 

Institutional planning has started with RTl\s preparing a model 
for one institution that can be used by all institutions • 

Institutional four-year operating plans will establish quantifi- 
able short-range objectives by indicating: 

1- the types of skills they should be producing for their com- 
munities J, 

2. the numbers that should be produced , and 

3. the time frame in which the skills should become available. 

The quantifiable objectives will become a management tool for the 
institutions - 

Planning and Budgeting Cycle (Handout #9) 

State does not have a formal budgeting cycle. Timing and experi- 
ence of last two budget preparation cycles have been used to prepare a 
budget cycle for the community college system. 

Requests for budget information will be made by department. Addi- 
tional time has been allowed for preparation of budget information to 
avoid "crash jobs." 

Planning cycle has been phased into budgeting cycle to provide 
approved plans for preparation of budget information. 

1973-75 biennium is "target" for use of plans in preparing budget 
in^f ormation. 

Planning cycle will be adjusted during next two calendar years to 
reach a regular planning and budgeting cycle by calendar year 1973. 
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PPBS 

Our plans are designed to be used with our present budgeting 

system. 

Plans also designed to be converted to a PPBS when the state elects 
to undertake such a conversion. 



\ 
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HANDOUT #2 



NORTH CAROLINA COMMUNITY COLLEGE SYSTEM 



STATE BOARD OF EDUCATION 



PROVIDES POLICIES, REGULATIONS AND STANDARDS 



1 ' 

! DEPARTMENT OF COMMUNITY COLLEGES | 

j I 

! S 

) ! 

i IMPLEMENTS AND ADMINISTERS POLICIES, REGULATIONS ; 

! f 

AND STANDARDS OF THE STATE BOARD OF EDUCATION ! 

I 

AND COORDINATES THE WORK OF THE INSTITUTIONS | 



INSTITUTIONS 

\ 

PROVIDE THE EDUCATIONAL AND TRAINING PROGRAMS 
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HANDOUT #3 
MULTI-ROLES OF ALL INSTITUTIONS 




OCCUPATIONAL EDUCATION ('TECHNICAL') 




TWO-YEAR PROGRAMS TO TRAIN TECtlNICIANS 


- 


ONE-YEAR PROGRAMS TO TRAIN CRAFTSMEN 
OCCUPATIONAL FXTRN^^TDN PROCPAM^? 


-1 


SHORT COURSES TO RETRAIN OR UPGRADE EMPLOYED PERSONS 

A niTT T TlA QTP PHTTPATTnTsJ 


• 


PROGRAMS FOR PERSONS WITH LESS THAN 8 YEARS OF EDUCATION 
ADULT HIGH SCHOOL EDIJPATTON 




PROGRAMS TO QUALIFY ADULTS FOR HIGH SCHOOL DIPLOMA OR CERTIFICATE 

HFNFPAT AFiTTTT FnTTPATTOM 
oCjlNrjlVrl J-i iWJyj LiL iU\J\J\ji\L J.ULN 




SHORT COURSES TO SERVE ADULT GENERAL EDUCATION REQUIREMENT OR 
AVOCATIONAL INTERESTS 

NEW INDUSTRY TRAINING 




SPECIAL TRAINING PROGRAMS FOR NEW INDUSTRIES OR EXPANDING 
^ INDUSTRIES 

liANPOWER DEVELOPMENT TRAINING ACT 




OCCUPATIONAL AND BASIC TRAINING FOR UNEMPLOYED DISADVANTAGED 



ERIC 



Purocse 



The. purpose of ths Norch Carolina Community College System Is to 
fill the gai> in a broad range of educational opportunity between high 
school and the senior college or university. in carrying out this role, 
the system of technical institutes a/nd community colleges offers occu- 
pational, aca Je-nlc , and cultural education and training opportunities 
from basic education through che cv/o-year college level, at a convenient 
place and at a minimal cost, to anyone of suitable age who can learn and 
whose needs can be met by the institutions within the system. 



Goals 



1. To open the door of each institution to all persons of suit- 
able age, who show an interest in and who can profit from the instruction 
offered, with na individual denied an educational opportunity because of 
race, sex, or creed. 

2. To provide a variety of quality postsecondary educational 
opportunities at less than baccalaureate level and consistent with the 
abilities, desires, and needs of the students to fit them with the skills, 
competencies, knowledge, and attitudes necessary in a competitive society. 

3. To provide for industry, agriculture, business, government, 
and service occupations the pre-service and in-service manpower training 
that requires less than baccalaureate-le.vel preparation. 

. To provide specific training programs designed to assist in 
fostering and inducing orderly accelerated economic growth in the state. 

5. To provide activities and learning opportunities which meet 
the adult educational and community service needs of the residents of 
the community by an institution. 

6. To direct the resources of the community college system toward 
a search for solutions to urgent cominunity problems. 

7. To pro\ride, in both curriculum and non-curriculum programs, 
the education needed to assist individuals in developing social and eco- 
nomic competence-, nnd in achieving self-fulfillment. 

8. To Improve the services of the institutions and the qualicy of 
the education and training opportunities through constant evaluation and 
study. 
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HANDOUT #6 



COMMUNITY COLLEGE SYSTEM GRADUATES 
AND ENROLLEES, 1970-80 DECADE 



COLLEGE TRANSFER 
TECHNICAL 
VOCATIONAL 
ADULT HIGH SCHOOL 
ADULT BASIC EDUCATION 
TOTAL 



GRADUATES 
NUMBER (000) 

97.1 
111.3 

81.8 
224.6 
166.0 
680.8 



ENROLLMENTS 
NUMBER (000) 

171.9 

258.3 

174.9 

246.2 

249.0 

1, 100.3 
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HANDOUT ?/8 



OCCUPATIONAL EDUCATION 
STATEWIDE GRADUATION TARGETS 

TECHNICAL VOCATIONAL 





19 71-73 


1973-75 


1971-73 


1973-75 


TOTAL 


15 ,793 


19,105 


15,331 


17,822 


PROF, TECH, KINDRED 


1, 750 


2,131 


459 


518 


ENG. TECH. 


49 


58 






MED & HEALTH 


486 


569 


166 


184 


TEACHERS, EL. & SEC. 










OTHER P, T, K 


969 


1,210 


188 


219 


MGRS, OFFLS, PROP. 


3, 129 


3, 772 


1 


2 


CLERICAL 6c KINDRED 


7,671 


9,331 






STENO, TYP, SECTY 


3,937 


4,864 






OTHER CLERICAL 


3, 734 


4,467 






SALES WORKERS 


1,715 


2,044 


699 


803 


CRAFTSMEN, FOREMEN 


1,302 


1,555 


5,125 


5,945 


CONSTRUCTION 






630 


718 


MECH & REPAIR 


27 


34 


2,508 


2,898 


METAL 






584 


684 


OTHER 


1,275 


1,521 


1,403 


1,645 


OPERATIVES & KINDRED 


73 


86 


5,884 


6,906 


DRIVERS & DELIV, 


73 


86 


266 


306 


OTHER 






5,618 


6,600 


SERVICE WORKERS 


333 


397 


3,007 


3,472 


PVT. HOUSEHOLD 






325 


368 


PROTECTIVE 


116 


139 






FOOD 


158 


187 






OTHER 


59 


71 


2,682 


3,10h 


IABOREkS, EXC F & M 










FAP_M OCCUPATIONS 


66 


83 


261 


291 



72 

ERIC 



ON 



I 

0) 

o 

c 

•H 

4J 
(U 

{>0 

D 
PQ 

c 
c 

•H 

C 

c 

rH 





















O 








M-l 








Q) 
















CO 
















C 
















}-i 








CT3 








0) 






c 


ft- 






•H 








4J 


4J 






0) 


cu 






w: 
















D 


D 






PQ 


fO 








tn 


0) 








}-l 






1 


D 






m 


4J 








CtJ 






ON 


r-H 






i-H 


w 








■cH 






4J 








U 


(U 






cd 








4J 








CO 






m 
















ON 














1^ 



C 

C 
C 



^1 



4J 



to 

0) 



o 

M-l 

> 
•H 
0) 
U 

a> 
o 

D 

m 











art 


Eor 


















«) 




CO 


fO 










O 








D 






nendatic 


cd 

QJ 




"A" b 




ees 


U 








a 


• 






4J 










•H 


recomi 
ts. 


to 


a 


1 




UIUl 






m 




o 










o 


0) 


o 


<JN 










(U 


»-H 




6 




CO 








u 


M-l 'a 


cd 


o 


CO 




o 


O D 










M-l 




M 




(U 
•cH 




o 


C 

o 


cd 


4J 


> 








4J 


<D 


(U 






4J - 


CO 


W) 








Cd 




t3 




CO 


c 


>-i 'a 




D 




a 




cd c 






c 


o 


4J 


a. Cd 






cd 


•cH 


(U 


(U 








4J 


cu 




CO 


< 


CO 


o 


B 


CX PQ 


c 


(U 


(U 






o 




> 




CO 




•H 






o 




o 


U 




(U 


}-l 




t,v' 


D 




o 


cu 


o 


1 


4J 




(U 






^ tn 


•r-t 




u 


w 






4J 


o> 






o 


O ON 


to 








<: 




C 












M 













CI 



dI cu] o 
< w o 



o 

o| cu 









c 




• 




an 


fo 




o 

CO 


o 


ons 




on 


CO 




c 








00 


c 




o 






o 




cd 




•cH 


CO 


o 


M-l 


o 






4J 




cu 




4.) 


a 




D 


Cd 




CO 






o 


4J 




o 


C 


cn 






•cH 


CU 




'"j 




o 




4.J 




cu 


-1 




•iH 


m 


CO 






a 




4J 




0 




w 






D 




•H 






cu CTk 




4J 


rH 




<n 


Pm 






•H 


1 


O 






•H 


CO 


4J 




4J 


ON 


4J 


13 O 




CO 








0) 


CU 4J 


o 


c 




CU 




tj 




•H • 


•H 


C 


o 


CU 


XI 


c;j tn 






cd 




CO 


D 




0) (U 


CO 




cd 


D 




CO : 


Oi 4J 


CU 


cn 










0) 


> 


00 


■cH 


M-l 




M-l 1 


M f-l 


o 






M-l 


< 


o 


O Oi 


u 


o 


to 


I'd 




M-l S 


a 






4J 






O 


cu 






CO 




o c 


CO O 


cd 


cn 


na 






•rH cd 












CO 


cd 








Cl 


in 


•H tn 




c 




M-l CO 


cd 




> 00 


a 


Cd 


1 


c 




CJN 


CU 


o 






CO cd 


cn 


rH 


>-i o 


P 4J 


CO 




CU r-H 






4J 


o 


§ 


CO 


73 a. 


O 


CU 


CO 


■H ro 








•tA 




4J tn 




•H 


O 


> }-i 


4J 


Cd 




D - 




•fH 


O -iH 


D 


f:u 


Cd 1 




0) 


U 


U CU 


4J 


cu 


4J rH 


•H : 




CU 


p. 




u 


CO : 






a 




4J 


cu 




CO 






w 


CO 




u 


c 


PQ 




PQ 


C 




u 


M 


CO 




CO 


M 







73 



c 

4-J 
D 



CM 



c 

4-J 

(U 

'd 

D 
PQ 

'd 
C 

c 
c 
cd 

r— I 



04 



o 

4J 

"O 
0) 
4J 

c 

0) 
CO 

U 
Cu 

m 

O 

u 
a 

0) 

O 

a. 
w 

4.J 

a 
to 

XJ 
D 



CM 








ON 


cd 


f— J 





o 

4-i 
O 

o 



CO 

c 
o 

a 

0) 

O 

u 
w 



(U 



0\ 



O 



CO 

c 

o 

4-) 

o 

o 

O 
V-l 

H 



(U 

to 



CO 

u 
cd 

o 

Q 

PQ 



o 

(U 

c 
cd 

•H 

D 
00 



00 
•J 



t 

ON 



CO 

> 

(U 

u 

(U < 

U O 
CO 

u <: 

u 

Q 









U 




( 1 


CO 














f -I 




0 












C'3 
















00 




CO 






Cd 










C 
















0 




PQ 






' J 


111 




•H 






PQ 




^ J 






4-) 




0 


— 




! < 






Cd 




4-J 






••5 






















c 




4-J 






! 4 






(U 




(U 


1 






(0 




^ 


CO 


00 






CJ < 


12 

CJ 


















0 


0) 


a 


ON 


w 


t 1 






CJ 


00 




1— J 


PQ 


J i 






(U 
















v-l 


a 








-0 


^ 










0 




! 






(U 




td 






. J 


4J 




0 




i-H 








CI 




4-1 


p 


i-H 








;>N 




4-J 






c 






CO 










0 


u 
















<D 




(J 


PQ 








4-J 


X> 






<: 




cd 




Cd 


•H 


t 


<J 




CJ 








CO 




r^ 


0 








a 


f i 


f-l 




CO 


CO 






0 












to 


1 


CJ 




c:) 




(U 




4-J 






n 




0) 


•«-t 


ir, 




0 


CO 




^'^ 


4-J 


I> 






0 


JJ 




4 J 




(U 


1 




(U 


<D 




•ij 








SU 


V-i 


00 
'd 


r ^ 




es 


u 


ON 




u 




m 


il 




CA 


I— 1 


OC 


PA 
LA 




r • 

C N 


0 








Q 






r < 







^1 



n 



CJ 


















CJ 


rH 




•1 i 

\ 4 


to 




t > 






i) 








13 




ru 
< 1 






4J 
CJ 
4 J 


an 




f ^ 






CI 








1 




C^ 


CO 










(J 


0 




( ] 


nd 




J > 


4-» 




r 4 


cd 




(4 


CT) 




















(1. 


1 






CO 




tj 


















•1 1 






1:3 


















C) 


r>. 




Cj 


CO 












13 






0 


13 


CI 


0 




4 J 


4J 


(U 


» > 


•r4 








JJ 


CJ 


V-l 


1 






(U 




(U 


r-l 






r-l 


> 




1 




1 




CJ 






•H 




ora 




or 


0 






u 






4J 


<') 


















C3 







r4l 



74 















D 


c 






•iH 


<u 


■P 


0) 


a 




o 




o 






PQ 


CM 








ON 




r— 1 




1 




0) 








O 












C 








4J 




a; 




DC 




xi 


ON 


o 


r— 1| 


pq 




















.5 












C 




(d 




r-H 









c 



r I 

I) 
c) 



< 

E 
o 



::5 oj 
13 



13 



(0 13 

m CO 

O 00 



o 

! 

> 
U 

to 

W 

wj 13 



I 

r-H 
I 



O 

4J 

D 

4.4 
4J 



O 
U 



o 
0) CO 

o : 



0) 




W) 




13 




D 








in 








1 




CO 








ON 




r-H 


0) 








D 


o 


U 




cfl 






w 


w 


CJ 


•H 


o 


to 




0) 


U 




(0 






0) 








O 


a* 




u 


0) 




05 






oo 


U 




cd 




4J 




W 


cd 




0) 


O Xi 


U 




P 




! 












o 





1 

a) 
o 

c 

4J 
0) 

PC 

C 
CO 

C 

c 
c 





o 


















y ^ 
























oO 










c 


•H 




•H 






4J 






01 


(1) 




C5C 






'D 














Qj 






' CO 
























































to 




cr. 








CO 






•H 






bf) 





















































o 










c 








o 








•H 






1 




! 






:3 








4-> 


1 






•H 






0) 


4J 






CO 4J 


CO 








C 


C 




O "-H 


•H 


03 




•rt a* 








u B 


CO 




c 


Q) O 


0) 


00 


•H 


a. o 


> 




c 




o 


o 


c 


>-l LO 


u 






o 


cu 












o 








(0 




) 














C 


J 






03 






a« i 










CO 


u 




a I 




O 




o 


OJ 
















> 


CO in 




o c 




C 












•H 




r-l 0 






w 






to a> 


pq 








CO 













0) 

u 

3 



00 

(1) 



o 
u 
u^ 

> 

•rH 

(1) 

O 
(U 



(1) 

00 

I 















L, 








1/' 








i- 








co 






00 










c 


C 








o 










03 • 












<D 




<u c 








o 


4J 


c 






4J 


a) 






•H 




o o 










t 


S 


o • 




ro 


o 


o CO 


'in o 




CJ 


(U 4J 








M 0) 






B 


00 


CO 




u 






CO 


o 




. H 










d) 










o 


5 r 


03 4J 


> 




•H U 










t/) 00 




00 








c 








•H 


ca c 


C ^ 


c 


4J 


a* cd 


03 ^ 


cd ' 


(1) 


0? 




CO 


(1) 




CO < 

c r 


CO C 


6 


PQ 


(1) o 






o 


> -H 


CO 


U " 


'H m 


•H OJ 




o m 




0) o 


r-H 






O 0) 


o 




CO 






-Si ro 




M O 








U 




o <J\ 


a 


o a* 
Q 







§1 H 11 ^1 ^1 I ^1 



o 



> 



0)1 















O 






CO 


u^ 






c 








cd 


CO 




t 




C 




•H 




cd 


0 


4J 


w 




4J 


CO 




O4 




c 






ro 






(1) 
73 




O 








4J 


ON 00 


§ 












OJ 


3 


4J 




o 


0) ^ 


03 




c • 


t/j 


4J 


a 


(TJ CO 


3 


CO 


03 


c 






•H CTJ 




ro 


3 --^ 




0 


00 


00 a. 


03 










C 


0 




CO : 


0 


4J 


C 0) ^ 


CO 


•H 






CO 


ro 


•H ^ 


a ON 


•H 








> 






CO 






CO C 


CO (1) C 






0) o 


CMC 








O 03 'H 


CO 




•H CO 




4J 


CO 


> C 


■u a) o 


u 


'O 


O O 


3 ^ a) 


cd 


0 


U 'r4 


4.1 04 




•H 


a* u 


•H o 


CO 






-J O 




d> 


W 4J 


a) 4J 04 


CJ 




PQ 




C3 




C/D 


M 







76 







Q 












CO 




c 
















i./ 
t 




T5 








CJ 

> 

•I-i 




CO 




w 












'J 












OJ 




CO 








Q 




















u 












OQ 


i 

c 














G 




o 














m 






*!! 








■M 
















O 


i_i 

M 










H> 










<<> 


o 








tJ 


Aft 






CJ 








U} 
















ft 














c 










Q 






x> 


M 














o 

■H 








ns 


03 


_ 




Cic 


Ou 






'.0 




(Si 




AJ 






— ^ 


o 
















c 








O 






■H 










to 
















CD 


CQ 


CO 












•> 


M> 






•H 








•-n < 




c 


CO 








u 
















O 








' <J 








o 








■J 


m 










Q 


c 


00 
























< 














crl 
















o 






E 


















c 








■H 






E 
















\^ 


o 






H 


W 


u o 




G 








OJ 
















fi^ 


■X 






'J 


^ 


, 




oo 


cs 


























Q 




-n 


HI 






U ' 


cn 


t J j' 





•M 








5-^ 


CO 






D 


1 J 






i- 1 


CJ 




Q 


G; 
















X 


c/) 












DQ 


00 


o 


C CJ 




di 




CO 














'O 






x> 




9 c 

E CO 


< 


OJ 


O 




w 




CO 








aj 












4J 






PQ 




















1-J 


E 




4J 






CO 




Q) PQ 








00 


O 




0) 


O -H 


00 






^ u 






00 < 


o 






o 


-o 


■H 




00 




CU 






CO 


>> 




0) 










D 


W 


< 


-o 


00 


r-H 




< 


TD 


X 


C 


r-H O 


ON 






-o 




■H 




D 




r-H 


O c/) 




C 




CO 


r-H 4J 


r— 1 






u 




> 






O u 


O 


O iJ 




0) 


TD 




O 








CO 










0) 




0) 


w 


E 


0) 






1 




< 


o 


< 


Q 




>^ 


iJ 00 




w 00 


iJ 


E 


t-i 


£Q 


CU 


















C TD 


>^ 




•I-I 


o 


0) 






fl) 










4J 


CO 


O 


a> D 


4J 


> D 


B 


o 


T3 




u c 


1—4 






0) 


CO 


0) 


:2 


W 


S XI 


•H 


.r4 XI 


X 


0) 


•H 


CO 


•rH CU 


o 










00 




•H 


4J 


C 


0) 


D 




CO 




a vi 






1 


c\3 


1 




O 


> 


M r 




o = 


CO 




C 


1 




o 






4J 










CO < 








o 


O 












CO 








< 


a* r 






a 


CCA 


a 




E CU 


&c 




ON 




as 




Q 




cu 


O 




Q 




a> 


o 


c 




r— 1 








PQ 




Q 






Q 









CU 
00) 
TD 
D 

PQ 

-o 
c 

CO 

0£ 
C 

•rH 

c 

c 

rri 



o 

ON 



oq 
c 

CO 



X 

CU 



H It 



CO 




-a 




o 




•I-I 




u 




CU 












o 










O 


00 


4-i 


c 






t-H 


c 




c 


1 


CO 


»— 4 


»— 4 


1 


a. 


u 


TD 


u 


C 


CO 


CO 


4J 




CO 






CO 


CO 






o 


o 








4J 


r-4 


3 




4J 




•r4 


rH 


4J 




CO 




c 




M 





77 



ERIC 



u 
c 
f-l 
c 
c 

CO 



-a 



I 











<J^ • 










r-H QJ 


















u 


U 0 
O 4J 






W 




Uh CO 




C 


O 




r-H 




•H 






cn w 




4J 




B 






(U 


o 


o 


O W) 




W) 


o 










c 


M-l 








cd 




CO 


0) 




CO 


}^ (U 








4J 


CO U 


c 






CU 


Pu O 






W) 


W) 


Q) M-l 


4J 






T3 


U Q) 


C 




w 






o 










a 




> 




to CO 
















a) 


U 


J-i c 


o 




a 




CO -t-i 






cu 










}-i 


T3 


0) CO 








C 


CU 






o 


CO 


u 

Q 
Q 


t 




DD 




<u 











a 

c 
.1-1 

a) 

Tl 
D 
fQ 

CO 

60| 
C 

•rH 

c 
c 

CO 



o 

ON I 



I 



\ 



THE INTEGRATION OF PLANNING AND EVALUATION 



Robert T« Williams 

Center for Occupational Education 
North Carolina State University 



This paper is partially based ou ideas developed by Dr«. Coster 
and Or. Robert L. iMorgan of the Center and on forms developed by Joe 
Malinski, program planner in occupatioral edi cation for the Minnesota 
State Department of Education^ 

Through a contract with the North Carolina State Advisory Council 
on Vocational Education, our Center has agreed to produce a Master Plan 
for the Evaluation of Occupational Program In North Carolina. This plan 
is still in its first draft and will not be delivered before September. 
The work of Coster and Morgan provides the conceptual framework for the 
plan; I will provide much of the detail, Some of its elements will also 
be woven into this presentation. 

For the purposes of this paper, evaluation is defined ps the com- 
parison between the processes, outputs, and outcomes which arcj desired, 
and the processes, outputs, and outcomes which are actually observed* 
The planning process specifies those which are desired, principally 
through objectives* An evaluation of a single item may show that the 
observed level is' greater than, equal to, or less than the desired level. 
The decision-maker may then prepare to make decisions which redirect seg^ 
ments of the system- 

A moment is needed here to distinguish between output and outcome. 
Morgan brought this out in one of our staff meetings. An example of out- 
put is, '*The system produced 500 trained auto mechanics in FY 70." An 
example of outcome is, *'0f the 500 train^.d auto mechanics which the sys- 
tem produced in 1970, 365 of them are employed in the field for which 
they trained." Output refers to what the system produced; outcome takes 
into consideration how this product was absorbed into the envircment c 
This raises the question of whether we are responsible for placement of 
our products, and the answer is "yes," It is not " aough to throw them 
in'io tlie labor market and then forget about them. 

Under the definition used here, evaluation is definitely a part of 
the decision-making process « As such it cannot be delegated to subordi- 
nates and torgottei;jo Handout #1, A General Educational System Evaluation 
Model, -ioes an excellent job of pointing this out. The three observation 
boxes all feed into a comparison box, and the results of these evalua ions 
are returned to the appropriate decision-maker. For purposes of illustra- 
tion, let the policy-maker be the State B ard of Education, let the admin- 
istrator be the State Diractor of Occupational Education, and let the 
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imp 1 ciinenLur ;.>K! rj ].;c.ii s : pen. nt* ep.ci tint A .s j t 'ja . ii n common Co soi:tVi staces 
(includiiig i^Jf.)rrh Carol ivin) : -6 u ?x>a^'d -poLicy of uniform r eimburseinen t co 
local uhlCs (.'or re-employment programs, irrea pect. i ve oi: dilfrerenL ia 1. 
curricul.u.n losCs. A: tne. same rtrn»'^. a goal of Lha Board is Co encourage 
the establishment and operation of programs whic]iv;iil prepare persona for 
predicted and existing job opportunities. Giv^en this f raiTf?v;ork, the State 
Director would have the responsibility for encouraging and redirecting 
programs so as to Improve the match between training opportunities and job 
opportunit io'i - The resource allocation formula is one of his most power- 
ful tools- The Local superintendent^ after receiving information about 
job opportunities, reimbursement policies, and other aspects of the pro- 
gram, must mak^ the decision of which curricula to offer. Local financial 
constraints can be expected to be given high priority by him, and he will, 
therefore, frequently choose a low-cost curriculum, with lower considera- 
tion given to job opportunities and student aspirations than we would hope 
for. This decision is repeated across the state- Observed outputs, then, 
can be expected to be higher than desired outputs for low-cost programs, 
and observed outputs for High-cost programs will likely be lower than 
desired outputs. Such comparative information must be fed back to the 
policy-makers v/hen evaluation is part of the decision-making process. 
Evaluation serves a very important role in providing information which can 
identify causes with effects, and it will also point out conflicting poli- 
cies. In this v/ay. derisions based on subsequent planning will cause pro- 
gram changes to occur in desired directions. 

Please notice that responsibility for different levels of the plan- 
ning process rests with different levels of personnel. Relate this to 
the presentation by Pete Perkins, The mission of the system is given to 
it by legislation, atid the goals are determined by the policy-making 
body--at least the top level of goals,. However, the specification of 
product objectives is a technical and *^rof essional responsibility resting 
with the chief administrator and his ,.Mff, Finally, because the process 
objectives and operating procedures arc the responsibility of the imple- 
mentor, he should be instrumental in developing them. This model speaks 
directly to the restructuring\ of the organization and activities presently 
underway in so many of our state departments- I am indebted to\its de- 
signers, for their clarity and timeliness^ ' 

A second way of relating planning and evaluation uses the levels 
shown in Handout #2. Much of our statistical reporting doesn't get 
beyond Level 1, and even here we have often duplicated counting across 
years. We report output sometimes, but usually don't relate it to input. 
Handout #3 is an example of how they can be related. An unduplicated 
head count across years is essential when trying to relate observed out- 
put to desired output. Handout #4 is a planning document which relates 
future job opportunities to future curriculum outputs needed to fill 
those 'jobs. When observed outputs become available each year, they can 
be compared against desired outputs, and the decision-maker will have a 
basis for redirecting programs - Minnesota has prepared these data for 
all programs, and I have just pulled enough for an excerpt to illustrate ■ 
the point. This type of input-output data ought to be available to 
every State Director--but even so it only covers two levels of evaluation 
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HANDOUT #2 



LEVELS OF EVALUATION OF INSTRUCTIONAi. PROGRAMS 
IN OCCUPATIONAL EDUCATION 

r 



SYSTEM 
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INPUT 
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as shovn i Jrfftncour ^^2. Thv» data cell as r-^taing of the quality of the 
products, or ^.'/♦?r of wnit i^r^cifiv tafks tri^y can perform. 1 recently 
saw a <5h<ef-t irom Genrgia's laiert curriculum guide for radio and tele- 
\'isicn bervicing in ^'bich they ,-?tat*^d th& tasks a student could be 
*^.xpect6d Kc prirfcrrn utvi-p coinrlet ion of the firr»t quarter, second quarter, 
etc Ve b3\f^ rt^printed it as Hav^dout, ifb, Tris spMks to Level 3, prod* 
uct performance* Georgia is apparently building this into all their 
curricula. The whol^t realni of behav^ioral obj'^.ctives is now available to 
help ui vich rhiy. Such an approach vri 11 challenge us to acce^rate 
moving a*-'av frc^n rhf traJiixonal curriculum practice of holding time 
constat*^ u'hi IP allowing achicu^iment t:o vary, to the possibilities of 
holding achi^jvemeat constant i/hi]<» aMt?\sfing time to vary We are begin- 
ning to make a trem^naous breakthrough In practicing the principle of pro- 
^?iding tdr i'rdivridual differences, v^rhich ha^'e espoused for so long. 

Moving to ),o"^l will r**quire a mote sj^stematic use of follow*up 
data than- many of us have* dona in the past. Again, follow-up information 
must he organized so as to b»? consistent with the information available 
for comparing LoveH 1 and 2. 1 would think th it follow-up studies In- 
volve more clf-ri^.al than proft>s.sional time, and that once a satisfactory 
form is designed and a cyclical routine established, follow-up studies 
would not be burdensome We have had some discussion in thi^ state con- 
cerning who should cciduct follow-up studies. It v^ould seem that manage- 
ment princ:^.ples would favor local rather than state action. The local 
decision-maker must ha\?e this information for his evaluation uses. I 
would advccat^ a fol!o\7-up system coordinated by the state offl,ce« highly 
consistent \ across the state, and conducted by the local agency* Summa- 
ries of local returns should flow to the state office, not raw data. And 
finally, an October folloy'-up the first year after leaving the institu- 
tion is insufficient. 

Level 5 is highly dependent en the successful implementation of 
the first four levels. Before making predictive forecasts of what is 
likely to result from the aaoption of various alternative programs, we 
need a data base of past, pfirformance in the system and of present per- 
formance levels. Dr. Gyuron^ovfired this more fully yesterday morning. 
The first four levels in Handout #2 concentrate on the student; but in 
addition to the information obtained for these evaluations. Level 5 
activities will a] so need cost data, by curriculum, by institution^ by 
local unit, and in other ways. Handout #6 is an example of how such 
information can he organized for analysis. At the state level, a sheet 
could be set up for each secondary bricklaying program, for example, and 
comparisons on one or more items made. Significant deviations could be 
analyzed tc try and determine v/hy they occurred* We ought to identify 
the factors common to the 20% high programs which are absent from the 
20% low programs, and vice versa. I would not advocate across-the-board 
adoption of this type of atnalysis because of the v'orkload, but it could 
be useful for analyzing those problems that catch our attention through 
the management by eKception principle. 

At the local or state level, this same form could compate one 
curriculum againsc another, with the results contributing to a decision . 
to discontinue, expand, or replace a particular curriculum. 
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RADIO AND r]:Lj{V[310N 3i'RVJCING 
OCCUP/VrioNAL COMPETENCY 

The quarle.r courses in radio and television have been arranged so 
Chat, sz the end o[ aiiy quarter tlie student v/ill hcve developed certain 
occupational skills'. Each additional quarter's v.\)rk will enable him to 
become employed at a higher degree of competency. The student who be- 
gins his Lrainin.L^ the first quarter arid continues to completion in the 
prescribed sequence v/ill, of course, ht- the most skillful, as he should 
possess all ilic skills and related knovrledge that can be acquired from 
e a c: h q ua r t e r ' s wo r k 

FIRST QUARTER 

SKILLS: Radio and television helper--At the end of this quarter, the 

student is familiar with radio and TV layouts. He can test and 
replace defective parts as well as pick up and deliver sets. He 
knows safety in handling TV, 

SECOND QUARTER 

SKILLS; Radio and teleVision helper — Knows a good deal more about the 
fundamentals of electricity and its workings. Performs basi- 
cally the same duties as the first-quarter student. 

THIRD QUARTER 

SKILLS- At the end of the third quarter the student should be able to 
locate, repair, ^^nd maintain all types of receivers (AM, FM, 
automobile) and stereo amplifiers. 

FOURTH QUARTER 

SKILLS: Troubleshoots repairs, and maintains monochrome and color tele- 
vision and possesses the skills acquired through the first 
three quarters. 

FIFTH QUARTER 

SKILLS: Has a much broader knowledge of the troubleshooting procedures 
of solid state electronic equipment (receivers, monochrome and 
color televi sion;, stereo am.plif iers ) . 

SIXTH QUARTER 

SKILLS: Possesses the skills of a well-trained radio and television 
techni^iian and is able to install antennas, both simple and 
complex systems. He has a working knowledge of closed C'i.rcuit 
television systems. 



SEVENTH QUARTER 

SKILLS: Troubleshoots, repairs, and maintains any and all types of 
home entertainment audio and visual equipment. 



EIGHTH QUARTER 

SKILLS: At the end of the eighth quarter the student has a well-rounded 
knowledge of both receiving and transmitting (fundamental) 
electronic equipment. He has the knowledge and skills to repair 
receiving equipment and the transmitting equipment* 



Fi/\NDOUT 



#6 



INSTRUCTIONAL PROGRAM ANALYSIS 
PROGRAM YEAR 197 



AVERAGE OF ALL 

INPUTS (COSTS) THIS PROGRAM PROGRAMS 20% HIGH 207. LOT 

Instruction _ 

Admin. & Supv. 

Equipment 

Supplies 

Teaching 

Curriculum Dev. . 

Cost per Student 

Length of Program 

Number of Students 

Entering 

Other Student 

Characteristics ^ 

Other Inputs . 

Other Inputs 



OUTPUTS (IlETURNS) 

Number of Graduates 
Number of Graduates 
Working 

Other Outputs 
Other Outputs 

Number of Mouths 
Apprenticeship Credit 
for Training 

Other Outputs 
Other Outputs 
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As stated jearlier. evaluation is defined here as the comparison 
between the, pro.ce.sses, outputs, and outcomes which are desired^ and the 
processes, outputs ^ and outcomes which are actually observed. This pre- 
supposes that in the planning processj decision-makers commit themselves 
to desired processed, outputs^ and outcomes- Without this commitment, 
this definition of evaluation is. useless. The first four levels of 
Hai?.dou!:: #2. present no trouble in reTating to this, but Level 5 forces us 
to make some commitments about analytical measures and alternative pro- 
grams. We must make some commitment with respect to an anticipated cost 
per student, or to using the results of analyses to change policies and 
formulas. Elaborating on the example used earlier, if a state objective 
were to seek enrollment of 100% of the annual need for machinists in 
machine shop programs, but the higher capital outlay cost prevented suf- 
ficient local commitm.ent to offer enough tra-.nang stations, then the 
analysis* which points this out must be made available to the body which 
promulgated the equalization policy and the administrator who set the 
100% objective. Recommended changes might be included. In this way eval- 
uation IS part of the decision-making process^ 

I do not advocate any one particular state staff organizational 
pattern for integrating planning and evaluation. The first requirement 
is a comraitmient to do so by the State Director- The second requirement 
is a planned management information system- The third requirement is the 
provision of qualified and interested personnel who are given the time 
to do this work. The fourth requirement is the establishment of a plan- 
ning, programming, budgeting, and evaluation- cycle in which each partici- 
pa"^-t has a target date for completing his tasks. 

Almost nothing has been said so far about process evaluation. The 
primary concern for process should be at the implementor level, which 
will frequently mean the local lev^l) The adjective was "primary 
North Carolina is one of those states where evaluation of the process of 
occupational education has been a state-level responsibility • Much of 
this should be delegated to the implementor and his staf f--delegated, 
not dumped; over a period of tim.e, not all at. once; and only when he has 
the resources to get the job done. There are school systems in this 
state with no assistant superintendents, no local director of occupational 
education, and one supervisor for all 12 grades*, A superintendent of such 
a system is not in a position to spend much time on the evaluation of the 
process of occupational education in his schools; but gradually he, or 
his principals, or area directors of occupational education, or state 
staff on loan for a full week or more will have to take over the job. 

Many of the pieces usually belonging to process evaluation would 
seem to have an appropriate place in the system model depicted in Handout 
#1. I have gi^^efi this area of evaluation little thought to date and have 
not yet discussed it with those who have been involved in process evalua- 
tion. The principal change might be in ways of formulating the desired 
objectives and recording the observation of procedures in such a way that 
the observations could be compared with the desired objectives < As be- 
fore, self^evaluation will have a place at both the teacher and local 
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unit level- However, I would not expect the decision-maker to rely only 
on someone else's self-evaluation--refer to Mr. Doty's program indepen- 
dent data idea. 

Regardless of whether the evaluation is product'^oriented or 
process-oriented, its value v/ill be largely determined by when and in 
what form its results reach the decision-maker and by his commitment: to 
include its results in the planning process. I challenge you to begin 
tying evaluation results directly into planning. Do not wait for some 
researcher to do it fqr you. Start where you can now, and develop a 
schedule for expanding this concept, activity by activity. For most of 
us, the integration of planning and evaluation will be an evolutionary 
process. 
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APPENDIX A 

PLANNED CONFERENCE PROGRAM 
ACTUAL CONFERENCE PR0GRA14 
CONFERENCE PLANNING COMMITTEE 
CONSULTANTS 
PARTICIPANTS 
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APPENDIX B 
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Exhibit #1 



October 27. 1969 
Lillington, N. C. 



TO: High School Principals and Other Interested and Involved Persons 

FROM: Sherrill T* Goodman, Director, Occupational Education 

SUBJECT: Planning Local Occupational Education Programs 



MATERIALS 



Procedure : 

Please find enclosed several packets of information that should 
help you with planning and implementing comprehensive occupational educa- 
tion programs. I suggest that you peruse this information, and make it 
available to your personnel and others who are involved with this pro- 
cess, in an effort to become thoroughly familiar with the *'broad scope" 
of occupational education. 

The publication '^Planning Local Programs of Vocational Education « 
Some Steps" can serve as a guide to the process which we recently dis- 
cussed. It contains the same process that I sjjggested to you and your 
planning committee. 

Step One 

Hopefully, you have begun your planning process and have 
covered step one in determining goals and purposes. 

Step Two 

This is the organization of your "Occupational Education 
Curriculum Planning Committee," and certain advisory committees. 

Steps Three and Four 

Steps three and four will probably be performed concur?- 
rently. Step three relates to considerations for the committee 
to determine while the students are engaged in step four, the 
guidance and orientation phase, which we discussed. Step four 
should culminate in your "Initial Survey of Student Needs and 
Desires . " 
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Seep Fiv e 

Seep fiva i^LU. \rtv0l.v2 projecting priorities against the 
"Initial Survey of Sr.adeac Need^ and Desires'^ to deteimine a 
reasonable program to be. requested for offering. (Priorities 
Include labor marker demand, space, potential availability of 
instructo r equitxue;at , and sc on c ) 

St ep Six 

Step six involves Ihe preparation of courses of study, 
course outlines, specific equipment lists, plant facilities, time 
tables, and evaluation procedures for those courses that we are 
reasonably sure wiJ.l hv\ offered for fiscal year 1971 (beginning 
July 1, 1970). 

Certain Information will be requested by the county office as 
follows: 

January 10, 19 70 - A ''Report of Courses Requested by Students on 

Initia I Survey" 

March 1,, 1970 - A "Request for Instructional Programs Planned 

Whic?i Are Continuing, Expanding, or New in Fiscal 
Year 1971c" 



An "Equipment List - Instructional Programs Planned Which 
Are Continuing, Expanding or I^w in Fiscal Year 1971o" (This is 
your request for new and/or additional equipment,) 

Five-year plan - FY 1972, 1973, 1974, 1975. Projected 
Instructional Programs Planned Which Are Continuing, Expanding or 
New in Fiscal Year 1972, 1973, 1974, 1975, 

Copies of forms to be used for obtaining the above information are 
attached. The attached forms are for your information and planning. The 
final copies may be altered 9 lightly o 

I suggest that you implement the organizational and guidance func- 
tions inherent in this procedure immediately, Other\'7ise5 you will be 
pushed to complete the process. 

Please feel free to call on me if I can be of further assistance. 
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Exhibit n 



PLANNING LOCAL PROGRAMS 



OF 



VOCATIONAL EDUCATION 



SOME STE3?S 



105 



1 



STEP ONE 



DETERMINE PROGRAM MISSION GOALS AND PURPOSES 

To enable enrol lees to enter and maintain themselves in 
useful, gainful employment 

. . ^ To enable enrollees to acquire technical competence for 
the first job 

..-To enable ex^rollees to master those skills (technical, 
social, adaptive and conceptual) which will enable them 
to profit from on-the-job learning and to grow and mature 
as a worker 

. . * To prepare the enroilees to meet successfully the demands 
for change and renewal which future occupational develop- 
ments will require 



STEP TWO 



INVOLVE OTHERS 

Vocational Educators in the School System 

Other Educators and the Professional Staff in the School 
System 

. . c Community Groups 

Business Groups 
Industry Groups 
Labor Groups 
Social Agencies 
Governmental Agencies 
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STEP TWO (continued) 



State Division of Vocational Education Help 
Request State Consultant Help From, • • 

Robert A. Mullen, Associate Dj.rector 
Vocational Education 
Department of Public Instruction 
Raleigh, North Carolina 27602 

Sherrill T. Goodman, Loc^l Director 
Harnett County Schools 
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STEP THREE 



2 



1 

J 

DETERMINE THE NEblDCS) 

Base Planning or. Reliable FACT S 

Do the FAOi 'S Show a Need for the Program? 

. » . Detei'mip.e FacLS For .. r, , 

What Croups to h^K served? 
For VJhar Occupations? 
In What Numbers? 



Consider (Obtain Facts On) 

Nature of the Local Economy 
Local Job Market 

Regional and Natimal Job Trends 
Local, and Regional Educational Trends 
Local and Regional Economic Trends 
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STEP FOUR 



DETERMINE GROUPS TO BE SERVED 

. . The Job-Interested High School Student 
The Disadvantaged 
Students with Special Needs 
The Handicapped 
The High School Graduate 
The School Dropout 
Employed Workers 
Displaced Workers 
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STEP FIVE 



DETERMINE THE PROGRAM(S) TO BE OFFERED 

... A comprehensive Program 

In Terms of People Reached 
In Terms of Occupations 
In Types of Service 

... Occupational Orientation 

... Vocational Guidance and Counseling 

... Instructional Programs 
. . Practical Arts 

Industrial Arts 
.. Introduction to Vocations 
. . Home Economics 

Agriculture 

Trade, Technical and Health-Related Occupations 

Education 

Distributive Education 
Office Education 
.. Interrelated Occupations Education 

... Job Placement 

. . . FoIIow-Up 
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6 I STEP SIX 

5 



4 




PREPARING THE PLANS 

Rationale 
.r. De?:ails of Program Structure 

Phases of Development 
. . . Time Tables 

Costs 

Anticipated Benefits 
Plans for Evaluation 
... Plans for Periodic Adjustment 



PLANNING RESOURCES 



Public School Data 
Census Data 

State and Federal Division of Labor Statistics Data 

Professional Consultant Services. v. 

Robert A. Mullen, Associate Director 
Vocational Education 
Department of Public Instruction 
Raleigh, North Carolina 27602 

Sherrill T. Goodman, Local Director 
Harnett County Schools 
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Exhibit #6 



November 17, 1969 
Lillingtorij N. C. 

TO: Principals, Guidance Counselors, Occupational Education and 

General Education Teachers 

FROM: Sherrill T. Goodman, Director of Occupational Education 

SUBJECT: In-Service Education • Two hours certl fi cate renewal £redit_ 

33-Hour Workshop: Planning Local Occupational Education Programs 

Thursday Evenings^--^ :00 - 7:00 
Board of Education Annex.., Lillington,. N C. 
Beginning December 4, 1969 
Ending March 5, 1970 (No meetings during 

holiday season) 
No Cost to Harnett County Personnel 

This course will be offered in an effort to better orient and assist 
our personnel to plan and implement occupational education programs. Long 
needed emphasis is being placed on occupational education and its rela- 
tionship to the total education program. Teachers, guidance counselors, 
and principals at all grade levels will be involved with comprehensive oc- 
cupational education in the future, and are therefore encouraged to attend. 

A copy of the program is attached for your information. 

Please return, the registration form to my office immediately if you 
plan to enroll in the course c 

Thank you» 
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Exhibit #6 
(continued) 



REGISTRATION FORM 

33-Hour Workshop 
PLANNING LOCAL OCCUPATIONAL EDUCATION PROGRAMS 

Name School [ 

Grade Level ^Certificate Number ^ 

Field Home Telephone 

Mailing Address ^ 

I wish to enroll in the 33-Hour Workshop - Planning Local Occupa- 
tional Education Programs - for two hours of certificate renewal credit* 
I understand that my enrollment is a commitment to complete the class. 

Signed ' 

(for office use) 

Date Received 

Sequence ^ ^ 

App roved 
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CCMFERLNCP EXM UATIOV QUOIST lOVNA.IRF 

/ A.No summary: 



ERIC 



Circle one response (Strongly Agree, Agree, Undecided, Disagree, or 
Strongly Disagree) for each item, 

SA A ? D SD "^ 

1. The objectives of this institute were clear 

/to me. 8 15 

2. The objectives of this institute were not 

realistic. 4 111 7 

3» The participants accepted the purposes of 

this institute. 9 14 

4. The objectives of this institute were not 

the same as my objectives. 3 4 10 6 

5. I have not learned anything new. 2 9 12 

6. The material presented seemed valuable to me. 11 11 1 

?• I could have learned as much by reading a 

book. 4 12 7 

8. Possible solutions to try problems were not 

considered. 3 2 14 3 

9. The information presented was too elementary. 2 1 12 8 
10# The speakers really knew their subjects. 6 17 

11. I was stimulated to think about the topics 

presented. 8 14 1 

12. We worked together well as a group. 7 13 3 

13. The group discussions were excellent. 4 12 6 

•14. There was little time for informal conVer«» 

sation. 1 1 16 5 

15. I had no opportunity to express my ideas. 4 11 8 

16. I really felt a part of this group. 6 15 1 

17. My time was well spent. 6 15 1 1 



"k 

The original questionnaire listed all the possible responses with 
each question, and the respondent was asked to circle his choice. The 
numbers appearing in the columns instead of the possible responses repre- 
sent the, frequency with which each of the responses was circled. 
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SA A ? D SD 



18* The institute met my expectations. 5 15 1 1 1 

19. Too much time was devoted to trivial matters. 2 16 5 

20. The information presented was too advanced. 16 7 

21. The content was not readily applicable to 

the important problems in Chis area. 4 11 8 

22. Theory was not related to practice. 2 3 13 5 

23. The printed materials that were provided 

were very helpful. 9 11 3 

24. The schedule should have been more flexible. 1 1 15 6 

25. As a result of your participation in this 
institute, do yoU plan to modify eithei' 

your present or future work? YES 17 NO 4 



If YES, please describe the nature of the most important of such 
modifications and the activities which will be affected. 



26. As a result of your contacts with the participants and consultants 

at this institute, have you decided to seek some continuing means of 
exchanging information with any of them, i.e*, to establish some 
continuing relation with participants and/or consultants for the pur- 
pose of information exchange? 

YES 20 NO 2 



If YES, what types of information can the consultant or participant 
contribute that would be helpful to your work? 



27* To what extent were the objectives of this institute attained? 



ERIC 
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28. In your opinion, what were the major strengths of this institute? 



29. In your opinion, what were the major weaknesses of this institute? 



30. If you were asked to conduct an institute similar to this one, what 
would you do differently from what was done in this institute? 



31. Additional comments about the institute. 



32. If you had it to do over again, would you apply for this institute 
which you have just completed? 

YES NO UNCERTAIN 



33* If an institute such as this is held again, would you recommend to 
others like you that they attend? 

YES NO UNCERTAIN 
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Ihri 'JC/:-.:'-.r^;^ r-.'c? jdr:L f^Tr. cempleced by 23 of the confer- 
ence'.? i5 -arcici - . rivrrr; :cr.!:air.Dd 33 items, with a choice of 
five ;^f\-r'':t:'':.-^ rM- ..,- ...-^ « t ( j - j".--*. r f . tV.e fir ^i: 2A st:atements--strongly 
agree, agr^v'\, u-.:^o:;i " i :~ 3.^,.'- a;.d szrrvr^gly disagree. The last nine 
Items or. tht-: forrp. vii^-t"^ r.."'' -;.;.'»r'^'' :c.aus<v they required either a yes or 
no ani^iver or a vrir.t? re-p** . 

Each ^Ay Ay ?^ [), a : ST i -^pi'/.s^ was assigned a value from, one 
to fi^r^j fi.-'^'i cer.uzir.^: the mc d^.^itaNl.-? response to a particular item. 
In 11 cds.fy^ SA v^ar- rV.':. .uc.t'^ rr-'^.a tv-vpcrise.' the 13 others were worded 
negar.i v"t>': v n Sl"^ vas tti m. ^ f a ^crab if^. re^^ ponser 

Ir. scnri-'.g zY.c rerT-r-vs^..-: cm t-xach Item, the frequency for each 
ansv^er wa*- muitir ii .-^.d by tr val-^^ (1.-5) assigned to that answer. For 
example, item 1. vjcrdod vc r.i\'^-i'..y , e.l.:citf;d only two kinds of response. 
Fifteen perbons agrf:.^d »-:ith th-'^ stHt^.mfiTit ^ and eight agreed strongly. 
The vreighc^d ant'-'-^^.s i 1^ x U anj 8 v 5) add up to a total score of 100. 
This s.-^ore vii^-Ld^-J by tho na^ni^^ir ol' re.opor.donts (23) produces a mean 
value for i.t^^m I oE '^.?;<^. r^:i.s \'alu>.'^ lies bacween the agree value (A) 
and the stronglv a.Hrec^ N*a;ao (5), ir./^i. eating a favorable attitude toward 
the cbjecti''Vs of th*i Ci^rtrr^r.."^. 

To do-t-i-rmi: je rf^.^^.-i^r^.de.^*-? ' attitudes toward the conference in 

general , all i.r.-im meaa 3'..cr:^s v add'id together. The total question- 
naire scor^. wa5 98^66. Whrv: t.Kir;. tof'.al score Is divided by the number 
of quefc•Lio:^s (2^^), th.^, ri^-jjul*: :1s a mnar. questionnaire score of 4.11, 
indicating that the- ob lOv^i: i.^ -a- a 7.d procedures of the conference were 
viewed favorab ly by the-. parvi/.-ipaT^.ts , 



